Jul 09 04:51:29 devstack cinder-volume[75478]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 04:51:29 devstack cinder-volume[75478]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 04:51:29 devstack cinder-volume[75478]: we strongly recommend against using it for new projects. Jul 09 04:51:29 devstack cinder-volume[75478]: If you are already using Eventlet, we recommend migrating to a different Jul 09 04:51:29 devstack cinder-volume[75478]: framework. For more detail see Jul 09 04:51:29 devstack cinder-volume[75478]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 04:51:29 devstack cinder-volume[75478]: import eventlet # noqa Jul 09 04:51:32 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 04:51:32 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 04:51:32 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 04:51:33 devstack cinder-volume[75478]: INFO dbcounter [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Registered counter for database cinder Jul 09 04:51:33 devstack cinder-volume[75478]: DEBUG oslo_db.sqlalchemy.engines [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:51:33 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writer thread running {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 04:51:33 devstack cinder-volume[75478]: INFO cinder.rpc [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 04:51:33 devstack cinder-volume[75478]: INFO cinder.rpc [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 04:51:33 devstack cinder-volume[75478]: DEBUG oslo_db.sqlalchemy.engines [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:51:33 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Determined volume DB was empty at startup. Jul 09 04:51:33 devstack cinder-volume[75478]: DEBUG cinder.volume.manager [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75478) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 04:51:33 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 04:51:33 devstack cinder-volume[75478]: WARNING stevedore.named [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 04:51:33 devstack cinder-volume[75478]: WARNING castellan.key_manager [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 04:51:33 devstack cinder-volume[75478]: WARNING cinder.keymgr.conf_key_mgr [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 04:51:33 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75478) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 09 04:51:33 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] CMD "cinder-rtstool verify" returned: 0 in 0.412s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_db.sqlalchemy.engines [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:51:34 devstack cinder-volume[75478]: INFO cinder.rpc [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 04:51:34 devstack cinder-volume[75478]: INFO cinder.rpc [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 04:51:34 devstack cinder-volume[75478]: WARNING stevedore.named [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 04:51:34 devstack cinder-volume[75478]: WARNING castellan.key_manager [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 04:51:34 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_db.sqlalchemy.engines [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:51:34 devstack cinder-volume[75478]: INFO oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Starting 1 workers Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Started child 75635 {{(pid=75478) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Full set of CONF: {{(pid=75478) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] ******************************************************************************** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Configuration options gathered from: {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] ================================================================================ {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] allow_availability_zone_fallback = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] allow_compression_on_image_upload = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75635]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] allowed_direct_url_schemes = [] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] api_rate_limit = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] auth_strategy = keystone {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] az_cache_duration = 3600 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_availability_zone = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_host = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_name = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_stats_polling_interval = 60 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backup_api_class = cinder.backup.api.API {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backup_name_template = backup-%s {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backup_use_same_host = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backup_use_temp_snapshot = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] chap_password = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] chap_username = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cinder_internal_tenant_project_id = 5a9b5a91d7d447138907ec5008702b34 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cinder_internal_tenant_user_id = 0c57e45659c745d6856ed78785657873 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cloned_volume_same_az = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cluster = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] compression_format = gzip {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] compute_api_class = cinder.compute.nova.API {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] config_dir = [] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] config_source = [] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] control_exchange = openstack {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] debug = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] default_availability_zone = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] default_group_type = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] default_volume_type = lvmdriver-1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] disk_geometry = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] driver_client_cert = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] driver_client_cert_key = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] driver_data_namespace = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] driver_ssl_cert_path = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] driver_ssl_cert_verify = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] driver_use_ssl = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] enable_force_upload = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] enable_new_services = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] enable_unsupported_driver = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] enforce_multipath_for_image_xfer = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] filter_function = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance_api_insecure = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance_api_servers = ['http://192.168.122.130/image'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance_api_ssl_compression = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance_ca_certificates_file = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance_catalog_info = image:glance:publicURL {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance_certfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance_keyfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance_num_retries = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance_request_timeout = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] goodness_function = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] graceful_shutdown_timeout = 5 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] group_api_class = cinder.group.api.API {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] host = devstack {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] image_compress_on_upload = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] image_conversion_address_space_limit = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] image_conversion_cpu_limit = 60 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] image_conversion_disable = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] image_upload_use_cinder_backend = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] image_upload_use_internal_tenant = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] image_volume_cache_enabled = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] image_volume_cache_max_count = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] image_volume_cache_max_size_gb = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] init_host_max_objects_retrieval = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] instance_format = [instance: %(uuid)s] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] iscsi_target_flags = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] iscsi_write_cache = on {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] iser_helper = tgtadm {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] iser_ip_address = 192.168.122.130 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] iser_port = 3260 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] log_color = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] log_config_append = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] log_dir = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] log_file = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] log_options = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] log_rotate_interval = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] log_rotate_interval_type = days {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] log_rotation_type = none {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] max_age = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] max_logfile_count = 30 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] max_logfile_size_mb = 200 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] max_over_subscription_ratio = 20.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] message_reap_interval = 86400 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] message_ttl = 2592000 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] migration_create_volume_timeout_secs = 300 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] monkey_patch = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] monkey_patch_modules = [] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] my_ip = 192.168.122.130 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] no_snapshot_gb_quota = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] num_iser_scan_tries = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] num_shell_tries = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] num_volume_device_scan_tries = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] nvmeof_conn_info_version = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] nvmet_ns_id = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] nvmet_port_id = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] osapi_max_limit = 1000 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] osapi_volume_ext_list = [] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] osapi_volume_listen_port = 8776 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] osapi_volume_use_ssl = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] osapi_volume_workers = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] per_volume_size_limit = -1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] periodic_fuzzy_delay = 60 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] periodic_interval = 60 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] public_endpoint = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] publish_errors = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] quota_backup_gigabytes = 1000 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] quota_backups = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75635]: INFO cinder.volume.manager [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] quota_gigabytes = 1000 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] quota_groups = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] quota_snapshots = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] quota_volumes = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] rate_limit_burst = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] rate_limit_except_level = CRITICAL {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] rate_limit_interval = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] reinit_driver_count = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] replication_device = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] report_discard_supported = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] report_interval = 120 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] reservation_clean_interval = 86400 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] reservation_expire = 86400 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] reserved_image_namespaces = [] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] reserved_percentage = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] rpc_response_timeout = 120 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] run_external_periodic_tasks = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] scst_target_driver = iscsi {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] scst_target_iqn_name = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_down_time = 720 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] shell_completion = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] snapshot_name_template = snapshot-%s {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] snapshot_same_host = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] split_loggers = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] state_path = /opt/stack/data/cinder {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] storage_availability_zone = nova {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] storage_protocol = iSCSI {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] syslog_log_facility = LOG_USER {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] target_helper = lioadm {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] target_ip_address = 192.168.122.130 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] target_port = 3260 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] target_protocol = iscsi {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] target_secondary_ip_addresses = [] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] trace_flags = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] transport_url = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] until_refresh = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] use_chap_auth = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] use_default_quota_class = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] use_journal = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] use_json = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] use_multipath_for_image_xfer = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] use_stderr = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] use_syslog = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] verify_glance_signatures = enabled {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_api_class = cinder.volume.api.API {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_backend_name = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_clear = zero {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_clear_ionice = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_clear_size = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_copy_bps_limit = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_dd_blocksize = 1M {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_name_template = volume-%s {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_service_inithost_offload = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volume_usage_audit_period = month {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] zoning_mode = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_concurrency.disable_process_locking = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.auth_section = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.auth_type = password {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.auth_version = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.cache = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.certfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.include_service_catalog = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.insecure = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.interface = public {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.keyfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_password = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcache_username = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.region_name = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.service_type = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.130/identity {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.backend = dogpile.cache.null {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.backend_argument = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.backend_expiration_time = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.config_prefix = cache.oslo {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.debug_cache_backend = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.enable_retry_client = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.enable_socket_keepalive = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.enabled = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.expiration_time = 600 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.hashclient_retry_attempts = 2 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.memcache_dead_retry = 300 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.memcache_pool_maxsize = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.memcache_sasl_enabled = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.password = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.proxies = [] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.redis_db = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.redis_server = localhost:6379 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.retry_attempts = 2 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.retry_delay = 0.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.socket_keepalive_count = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.socket_keepalive_idle = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.socket_keepalive_interval = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.socket_timeout = 1.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.tls_allowed_ciphers = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.tls_cafile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.tls_certfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.tls_enabled = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.tls_keyfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cache.username = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] coordination.backend_url = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.asyncio_connection = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.asyncio_slave_connection = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.backend = sqlalchemy {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.connection = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.connection_debug = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.connection_parameters = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.connection_recycle_time = 3600 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.connection_trace = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.db_inc_retry_interval = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.db_max_retries = 20 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.db_max_retry_interval = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.db_retry_interval = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.max_overflow = 50 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.max_pool_size = 5 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.max_retries = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.mysql_wsrep_sync_wait = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.pool_timeout = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.retry_interval = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.slave_connection = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.sqlite_synchronous = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.synchronous_reader = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] database.use_db_reconnect = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.connection_string = messaging:// {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.enabled = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.es_doc_type = notification {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.es_scroll_size = 10000 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.es_scroll_time = 2m {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.filter_error_trace = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.hmac_keys = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.sentinel_service_name = mymaster {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.socket_timeout = 0.1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.trace_requests = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler.trace_sqlalchemy = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler_jaeger.process_tags = {} {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler_jaeger.service_name_prefix = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] profiler_otlp.service_name_prefix = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.enforce_new_defaults = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.enforce_scope = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.policy_default_rule = default {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.policy_file = policy.yaml {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] privsep_osbrick.group = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] privsep_osbrick.helper_command = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] privsep_osbrick.user = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cinder_sys_admin.group = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cinder_sys_admin.helper_command = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] cinder_sys_admin.user = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_user.auth_section = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_user.auth_type = password {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_user.cafile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_user.certfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_user.collect_timing = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_user.insecure = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_user.keyfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_user.send_service_user_token = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_user.split_loggers = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] service_user.timeout = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance.auth_section = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance.auth_type = password {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance.certfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance.collect_timing = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance.insecure = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance.keyfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance.region_name = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance.split_loggers = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] glance.timeout = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.backend_availability_zone = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.chap_password = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.chap_username = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.disk_geometry = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.driver_client_cert = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.driver_client_cert_key = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.driver_data_namespace = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.driver_use_ssl = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.extra_capabilities = {} {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.filter_function = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.goodness_function = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.iscsi_target_flags = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.iscsi_write_cache = on {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.iser_helper = tgtadm {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.iser_ip_address = 192.168.122.130 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.iser_port = 3260 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.lvm_share_target = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.lvm_type = auto {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.num_shell_tries = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.replication_device = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.report_discard_supported = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.reserved_percentage = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.target_helper = tgtadm {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack sudo[75639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.target_ip_address = 192.168.122.130 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.target_port = 3260 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack sudo[75639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.target_protocol = iscsi {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.trace_flags = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.unique_fqdn_network = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.use_chap_auth = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.volume_backend_name = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.volume_clear = zero {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.volume_clear_ionice = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.volume_clear_size = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_reports.file_event_handler = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_reports.log_dir = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.backend_host = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.chap_password = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.chap_username = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.disk_geometry = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.driver_client_cert = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.extra_capabilities = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.filter_function = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.goodness_function = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.iser_helper = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.iser_ip_address = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.iser_port = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.lvm_share_target = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.lvm_type = auto {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.num_shell_tries = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.replication_device = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.report_discard_supported = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.reserved_percentage = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.scst_target_driver = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.storage_protocol = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.target_helper = lioadm {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.target_ip_address = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.target_port = 3260 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.trace_flags = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.use_chap_auth = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.volume_clear = zero {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.volume_clear_size = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] lvmdriver-1.volumes_dir = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.ssl = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_notifications.driver = [] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_notifications.retry = -1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] key_manager.fixed_key = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.barbican_api_version = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.barbican_endpoint = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.barbican_endpoint_type = public {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.barbican_region_name = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.cafile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.certfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.collect_timing = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.insecure = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.keyfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.number_of_retries = 60 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.retry_delay = 1 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.send_service_user_token = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.split_loggers = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.timeout = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.verify_ssl = True {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican.verify_ssl_path = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican_service_user.auth_section = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican_service_user.auth_type = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican_service_user.cafile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican_service_user.certfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican_service_user.collect_timing = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican_service_user.insecure = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican_service_user.keyfile = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican_service_user.split_loggers = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] barbican_service_user.timeout = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.approle_role_id = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.approle_secret_id = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.kv_mountpoint = secret {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.kv_path = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.kv_version = 2 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.namespace = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.root_token_id = **** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.ssl_ca_crt_file = None {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.timeout = 60.0 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.use_ssl = False {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:51:34 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] ******************************************************************************** {{(pid=75478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 04:51:35 devstack sudo[75639]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:35 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:35 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:35 devstack sudo[75645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:51:35 devstack sudo[75645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:35 devstack sudo[75645]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:35 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.655s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:35 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 04:51:35 devstack cinder-volume[75635]: INFO cinder.brick.local_dev.lvm [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 04:51:35 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:35 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:35 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:35 devstack sudo[75889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 04:51:35 devstack sudo[75889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:36 devstack sudo[75889]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:36 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:36 devstack cinder-volume[75635]: DEBUG cinder.brick.local_dev.lvm [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75635) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 09 04:51:36 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:36 devstack sudo[76096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:51:36 devstack sudo[76096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:38 devstack sudo[76096]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:38 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.575s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:38 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:38 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:38 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:38 devstack sudo[76402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:51:38 devstack sudo[76402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:38 devstack sudo[76402]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:38 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.701s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:38 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:38 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:38 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:38 devstack sudo[76418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 04:51:38 devstack sudo[76418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:39 devstack sudo[76418]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:39 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.912s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:39 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:39 devstack sudo[76422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 04:51:39 devstack sudo[76422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:40 devstack sudo[76422]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:40 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.842s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:40 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:40 devstack sudo[76433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 04:51:40 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:41 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:41 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.750s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:41 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:41 devstack sudo[76440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:51:41 devstack sudo[76440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:42 devstack sudo[76440]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:42 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:42 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:42 devstack sudo[76448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:51:42 devstack sudo[76448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:42 devstack sudo[76448]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:42 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:42 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:42 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:42 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:42 devstack sudo[76453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:51:42 devstack sudo[76453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:43 devstack sudo[76453]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:43 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:43 devstack cinder-volume[75635]: INFO cinder.volume.drivers.lvm [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 04:51:43 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:43 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:43 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:43 devstack sudo[76463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:51:43 devstack sudo[76463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:44 devstack sudo[76463]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:44 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:44 devstack cinder-volume[75635]: DEBUG cinder.volume.drivers.lvm [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Updating volume stats {{(pid=75635) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 04:51:44 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:44 devstack sudo[76579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 04:51:44 devstack sudo[76579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:44 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:51:44 devstack sudo[76579]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:44 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:44 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:44 devstack sudo[76596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:51:44 devstack sudo[76596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:45 devstack sudo[76596]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:45 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:45 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:45 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:51:45 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:46 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:46 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.615s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:46 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:46 devstack sudo[76726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:51:46 devstack sudo[76726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:46 devstack sudo[76726]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:46 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:46 devstack cinder-volume[75635]: INFO cinder.volume.driver [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 04:51:46 devstack cinder-volume[75635]: DEBUG cinder.volume.driver [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75635) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 04:51:46 devstack cinder-volume[75635]: DEBUG oslo_db.sqlalchemy.engines [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75635) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:51:46 devstack cinder-volume[75635]: DEBUG dbcounter [-] [75635] Writer thread running {{(pid=75635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 04:51:46 devstack cinder-volume[75635]: DEBUG cinder.db.api [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Building query based on filter {{(pid=75635) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 04:51:46 devstack cinder-volume[75635]: DEBUG cinder.image.image_utils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75635) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 04:51:46 devstack cinder-volume[75635]: INFO cinder.keymgr.migration [None req-ab30db02-09b7-4803-8072-ae86bb2ba6b5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 04:51:46 devstack cinder-volume[75635]: DEBUG cinder.volume.drivers.lvm [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Updating volume stats {{(pid=75635) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 04:51:46 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:46 devstack sudo[76732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 04:51:46 devstack sudo[76732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:47 devstack sudo[76732]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:47 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:47 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:47 devstack sudo[76738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:51:47 devstack sudo[76738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:48 devstack sudo[76738]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:48 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:48 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:48 devstack sudo[76741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:51:48 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:48 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:48 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:48 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:48 devstack sudo[76744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:51:48 devstack sudo[76744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:49 devstack sudo[76744]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:49 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:49 devstack cinder-volume[75635]: DEBUG cinder.manager [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Notifying Schedulers of capabilities ... {{(pid=75635) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:51:49 devstack cinder-volume[75635]: INFO cinder.volume.manager [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Driver initialization completed successfully. Jul 09 04:51:49 devstack cinder-volume[75635]: INFO cinder.manager [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Initiating service 2 cleanup Jul 09 04:51:49 devstack cinder-volume[75635]: INFO cinder.manager [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Service 2 cleanup completed. Jul 09 04:51:49 devstack cinder-volume[75635]: DEBUG cinder.service [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Creating RPC server for service cinder-volume {{(pid=75635) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 04:51:49 devstack cinder-volume[75635]: DEBUG cinder.service [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75635) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 04:51:49 devstack cinder-volume[75635]: INFO cinder.volume.manager [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 04:51:49 devstack cinder-volume[75635]: DEBUG cinder.volume.drivers.lvm [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Updating volume stats {{(pid=75635) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 04:51:49 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:49 devstack sudo[76748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 04:51:49 devstack sudo[76748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:50 devstack sudo[76748]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:50 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:50 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:50 devstack sudo[76752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:51:50 devstack sudo[76752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:51 devstack sudo[76752]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:51 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:51 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:51 devstack sudo[76758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:51:51 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:51 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:51 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:51 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:51:51 devstack sudo[76816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:51:51 devstack sudo[76816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:51:52 devstack sudo[76816]: pam_unix(sudo:session): session closed for user root Jul 09 04:51:52 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:51:52 devstack cinder-volume[75635]: INFO cinder.volume.manager [None req-a98eafc6-1e0f-42c6-b453-99782893fb49 None None] Driver post RPC initialization completed successfully. Jul 09 04:52:02 devstack cinder-volume[75635]: DEBUG dbcounter [-] [75635] Writing DB stats cinder:SELECT=2 {{(pid=75635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:52:02 devstack cinder-volume[75635]: DEBUG dbcounter [-] [75635] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:52:26 devstack cinder-volume[75635]: DEBUG oslo_service.periodic_task [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running periodic task VolumeManager._thread_info {{(pid=75635) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:52:26 devstack cinder-volume[75635]: DEBUG cinder.volume.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] thread count: 6 {{(pid=75635) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 04:52:26 devstack cinder-volume[75635]: DEBUG cinder.volume.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] thread info: [<_MainThread(MainThread, started 128272885862528)>, , , , , ] {{(pid=75635) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 04:53:26 devstack cinder-volume[75635]: DEBUG oslo_service.periodic_task [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75635) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:53:26 devstack cinder-volume[75635]: DEBUG cinder.volume.drivers.lvm [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Updating volume stats {{(pid=75635) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 04:53:26 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:53:26 devstack sudo[81717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 04:53:26 devstack sudo[81717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:53:27 devstack sudo[81717]: pam_unix(sudo:session): session closed for user root Jul 09 04:53:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:53:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:53:27 devstack sudo[81720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:53:27 devstack sudo[81720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:53:27 devstack sudo[81720]: pam_unix(sudo:session): session closed for user root Jul 09 04:53:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:53:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:53:27 devstack sudo[81723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:53:27 devstack sudo[81723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:53:28 devstack sudo[81723]: pam_unix(sudo:session): session closed for user root Jul 09 04:53:28 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:53:28 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:53:28 devstack sudo[81726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:53:28 devstack sudo[81726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:53:29 devstack sudo[81726]: pam_unix(sudo:session): session closed for user root Jul 09 04:53:29 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:53:29 devstack cinder-volume[75635]: DEBUG cinder.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Notifying Schedulers of capabilities ... {{(pid=75635) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:53:29 devstack cinder-volume[75635]: DEBUG oslo_service.periodic_task [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running periodic task VolumeManager._thread_info {{(pid=75635) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:53:29 devstack cinder-volume[75635]: DEBUG cinder.volume.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] thread count: 6 {{(pid=75635) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 04:53:29 devstack cinder-volume[75635]: DEBUG cinder.volume.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] thread info: [<_MainThread(MainThread, started 128272885862528)>, , , , , ] {{(pid=75635) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 04:54:02 devstack cinder-volume[75635]: DEBUG dbcounter [-] [75635] Writing DB stats cinder:SELECT=1 {{(pid=75635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:54:02 devstack cinder-volume[75635]: DEBUG dbcounter [-] [75635] Writing DB stats cinder:UPDATE=1 {{(pid=75635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:54:26 devstack cinder-volume[75635]: DEBUG oslo_service.periodic_task [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75635) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:54:26 devstack cinder-volume[75635]: DEBUG cinder.volume.drivers.lvm [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Updating volume stats {{(pid=75635) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 04:54:26 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:54:26 devstack sudo[83272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 04:54:26 devstack sudo[83272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:54:27 devstack sudo[83272]: pam_unix(sudo:session): session closed for user root Jul 09 04:54:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:54:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:54:27 devstack sudo[83286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:54:27 devstack sudo[83286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:54:27 devstack sudo[83286]: pam_unix(sudo:session): session closed for user root Jul 09 04:54:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:54:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:54:27 devstack sudo[83309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:54:27 devstack sudo[83309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:54:28 devstack sudo[83309]: pam_unix(sudo:session): session closed for user root Jul 09 04:54:28 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:54:28 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:54:28 devstack sudo[83323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:54:28 devstack sudo[83323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:54:29 devstack sudo[83323]: pam_unix(sudo:session): session closed for user root Jul 09 04:54:29 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:54:29 devstack cinder-volume[75635]: DEBUG cinder.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Notifying Schedulers of capabilities ... {{(pid=75635) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:54:29 devstack cinder-volume[75635]: DEBUG oslo_service.periodic_task [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running periodic task VolumeManager._thread_info {{(pid=75635) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:54:29 devstack cinder-volume[75635]: DEBUG cinder.volume.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] thread count: 6 {{(pid=75635) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 04:54:29 devstack cinder-volume[75635]: DEBUG cinder.volume.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] thread info: [<_MainThread(MainThread, started 128272885862528)>, , , , , ] {{(pid=75635) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 04:55:26 devstack cinder-volume[75635]: DEBUG oslo_service.periodic_task [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75635) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:55:26 devstack cinder-volume[75635]: DEBUG cinder.volume.drivers.lvm [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Updating volume stats {{(pid=75635) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 04:55:26 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:55:26 devstack sudo[85141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 04:55:26 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:55:27 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root Jul 09 04:55:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:55:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:55:27 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:55:27 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:55:27 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Jul 09 04:55:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:55:27 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:55:27 devstack sudo[85159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 04:55:27 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:55:28 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root Jul 09 04:55:28 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:55:28 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:55:28 devstack sudo[85185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 04:55:28 devstack sudo[85185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:55:28 devstack sudo[85185]: pam_unix(sudo:session): session closed for user root Jul 09 04:55:28 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:55:28 devstack cinder-volume[75635]: DEBUG cinder.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Notifying Schedulers of capabilities ... {{(pid=75635) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:55:28 devstack cinder-volume[75635]: DEBUG oslo_service.periodic_task [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] Running periodic task VolumeManager._thread_info {{(pid=75635) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:55:28 devstack cinder-volume[75635]: DEBUG cinder.volume.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] thread count: 6 {{(pid=75635) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 04:55:28 devstack cinder-volume[75635]: DEBUG cinder.volume.manager [None req-14969005-9984-47f2-9e7c-5d76bd19f79d None None] thread info: [<_MainThread(MainThread, started 128272885862528)>, , , , , ] {{(pid=75635) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 04:56:02 devstack cinder-volume[75635]: DEBUG dbcounter [-] [75635] Writing DB stats cinder:SELECT=1 {{(pid=75635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:56:02 devstack cinder-volume[75635]: DEBUG dbcounter [-] [75635] Writing DB stats cinder:UPDATE=1 {{(pid=75635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:56:10 devstack cinder-volume[75478]: INFO oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Caught SIGTERM, stopping children Jul 09 04:56:10 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Acquiring lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 04:56:10 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Acquired lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 04:56:10 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Releasing lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 04:56:10 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Stop services. {{(pid=75478) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 04:56:10 devstack cinder-volume[75478]: DEBUG oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Killing children. {{(pid=75478) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 04:56:10 devstack cinder-volume[75478]: INFO oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Waiting on 1 children to exit Jul 09 04:56:14 devstack cinder-volume[75635]: DEBUG oslo_concurrency.lockutils [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Acquiring lock "singleton_lock" {{(pid=75635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 04:56:14 devstack cinder-volume[75635]: DEBUG oslo_concurrency.lockutils [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Acquired lock "singleton_lock" {{(pid=75635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 04:56:14 devstack cinder-volume[75635]: DEBUG oslo_concurrency.lockutils [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Releasing lock "singleton_lock" {{(pid=75635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 04:56:14 devstack cinder-volume[75635]: WARNING amqp [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 04:56:14 devstack cinder-volume[75635]: WARNING amqp [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 04:56:14 devstack cinder-volume[75478]: INFO oslo_service.backend._eventlet.service [None req-e351afe0-5d73-4682-aa0f-273c88366392 None None] Child 75635 exited with status 0 Jul 09 04:56:15 devstack cinder-volume[86169]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 04:56:15 devstack cinder-volume[86169]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 04:56:15 devstack cinder-volume[86169]: we strongly recommend against using it for new projects. Jul 09 04:56:15 devstack cinder-volume[86169]: If you are already using Eventlet, we recommend migrating to a different Jul 09 04:56:15 devstack cinder-volume[86169]: framework. For more detail see Jul 09 04:56:15 devstack cinder-volume[86169]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 04:56:15 devstack cinder-volume[86169]: import eventlet # noqa Jul 09 04:56:17 devstack cinder-volume[86169]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86169) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 04:56:17 devstack cinder-volume[86169]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86169) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 04:56:17 devstack cinder-volume[86169]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86169) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 04:56:17 devstack cinder-volume[86169]: INFO dbcounter [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Registered counter for database cinder Jul 09 04:56:17 devstack cinder-volume[86169]: DEBUG oslo_db.sqlalchemy.engines [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86169) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG dbcounter [-] [86169] Writer thread running {{(pid=86169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 04:56:18 devstack cinder-volume[86169]: INFO cinder.rpc [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 04:56:18 devstack cinder-volume[86169]: INFO cinder.rpc [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_db.sqlalchemy.engines [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86169) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:56:18 devstack cinder-volume[86169]: INFO cinder.volume.manager [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Determined volume DB was empty at startup. Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG cinder.volume.manager [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86169) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 04:56:18 devstack cinder-volume[86169]: INFO cinder.volume.manager [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 04:56:18 devstack cinder-volume[86169]: WARNING stevedore.named [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 04:56:18 devstack cinder-volume[86169]: WARNING castellan.key_manager [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 04:56:18 devstack cinder-volume[86169]: WARNING cinder.keymgr.conf_key_mgr [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 04:56:18 devstack cinder-volume[86169]: INFO cinder.volume.manager [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_db.sqlalchemy.engines [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86169) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:56:18 devstack cinder-volume[86169]: INFO oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Starting 1 workers Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Started child 86416 {{(pid=86169) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Full set of CONF: {{(pid=86169) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] ******************************************************************************** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Configuration options gathered from: {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] ================================================================================ {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] allow_availability_zone_fallback = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] allow_compression_on_image_upload = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] allowed_direct_url_schemes = [] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] api_rate_limit = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] auth_strategy = keystone {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_availability_zone = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_host = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_name = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86416]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_stats_polling_interval = 60 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backup_api_class = cinder.backup.api.API {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backup_name_template = backup-%s {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backup_use_same_host = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backup_use_temp_snapshot = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] chap_password = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] chap_username = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cinder_internal_tenant_project_id = 5a9b5a91d7d447138907ec5008702b34 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cinder_internal_tenant_user_id = 0c57e45659c745d6856ed78785657873 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cluster = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] compression_format = gzip {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] compute_api_class = cinder.compute.nova.API {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] config_dir = [] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] config_source = [] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] control_exchange = openstack {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] debug = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] default_availability_zone = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] default_group_type = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] default_volume_type = QuobyteHD {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] disk_geometry = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] driver_client_cert = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] driver_client_cert_key = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] driver_data_namespace = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] driver_ssl_cert_path = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] driver_ssl_cert_verify = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] driver_use_ssl = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] enable_new_services = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] enable_unsupported_driver = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] enabled_backends = ['QuobyteHD'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] enforce_multipath_for_image_xfer = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] filter_function = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance_api_insecure = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance_api_servers = ['http://192.168.122.130/image'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance_api_ssl_compression = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance_ca_certificates_file = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance_catalog_info = image:glance:publicURL {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86416]: INFO cinder.volume.manager [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance_certfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance_keyfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance_num_retries = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance_request_timeout = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] goodness_function = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86416]: DEBUG cinder.volume.drivers.remotefs [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86416) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] graceful_shutdown_timeout = 5 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] group_api_class = cinder.group.api.API {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] host = devstack {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] image_compress_on_upload = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] image_conversion_address_space_limit = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] image_conversion_cpu_limit = 60 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] image_conversion_disable = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] image_upload_use_cinder_backend = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] image_upload_use_internal_tenant = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] image_volume_cache_enabled = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] image_volume_cache_max_count = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] image_volume_cache_max_size_gb = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] init_host_max_objects_retrieval = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] instance_format = [instance: %(uuid)s] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] iscsi_target_flags = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] iscsi_write_cache = on {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] iser_helper = tgtadm {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] iser_ip_address = 192.168.122.130 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] iser_port = 3260 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] log_color = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] log_config_append = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] log_dir = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] log_file = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] log_options = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] log_rotate_interval = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] log_rotate_interval_type = days {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] log_rotation_type = none {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] max_age = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] max_logfile_count = 30 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] max_logfile_size_mb = 200 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] max_over_subscription_ratio = 20.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] message_reap_interval = 86400 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] message_ttl = 2592000 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] migration_create_volume_timeout_secs = 300 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] monkey_patch = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] monkey_patch_modules = [] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] my_ip = 192.168.122.130 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] no_snapshot_gb_quota = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] num_iser_scan_tries = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] num_shell_tries = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] num_volume_device_scan_tries = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] nvmeof_conn_info_version = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] nvmet_ns_id = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] nvmet_port_id = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] osapi_max_limit = 1000 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] osapi_volume_ext_list = [] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] osapi_volume_listen = 0.0.0.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] osapi_volume_listen_port = 8776 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] osapi_volume_use_ssl = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] osapi_volume_workers = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] per_volume_size_limit = -1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] periodic_fuzzy_delay = 60 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] periodic_interval = 60 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] project_id_regex = [0-9a-f\-]+ {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] public_endpoint = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] publish_errors = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] quota_backup_gigabytes = 1000 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] quota_backups = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] quota_gigabytes = 1000 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] quota_groups = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] quota_snapshots = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] quota_volumes = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] rate_limit_burst = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] rate_limit_except_level = CRITICAL {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] rate_limit_interval = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] reinit_driver_count = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] replication_device = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] report_discard_supported = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] report_interval = 120 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] reservation_clean_interval = 86400 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] reservation_expire = 86400 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] reserved_image_namespaces = [] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] reserved_percentage = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] rpc_response_timeout = 120 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] run_external_periodic_tasks = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] scst_target_driver = iscsi {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] scst_target_iqn_name = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_down_time = 720 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] shell_completion = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] snapshot_name_template = snapshot-%s {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] split_loggers = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] state_path = /opt/stack/data/cinder {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] storage_availability_zone = nova {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] storage_protocol = iSCSI {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] syslog_log_facility = LOG_USER {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] target_helper = lioadm {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] target_ip_address = 192.168.122.130 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] target_port = 3260 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] target_protocol = iscsi {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] target_secondary_ip_addresses = [] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] trace_flags = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] transfer_api_class = cinder.transfer.api.API {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] transport_url = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] until_refresh = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] use_chap_auth = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] use_default_quota_class = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] use_journal = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] use_json = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] use_multipath_for_image_xfer = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] use_stderr = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] use_syslog = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] verify_glance_signatures = enabled {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_api_class = cinder.volume.api.API {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_backend_name = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_clear = zero {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_clear_ionice = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_clear_size = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_copy_bps_limit = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_dd_blocksize = 1M {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_name_template = volume-%s {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_service_inithost_offload = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volume_usage_audit_period = month {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] zoning_mode = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_concurrency.disable_process_locking = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.auth_section = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.auth_type = password {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.auth_version = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.cache = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.certfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.delay_auth_decision = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.http_connect_timeout = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.include_service_catalog = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.insecure = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.interface = public {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.keyfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_password = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcache_username = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.region_name = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.service_token_roles_required = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.service_type = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.token_cache_time = 300 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.130/identity {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.backend = dogpile.cache.null {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.backend_argument = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.backend_expiration_time = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.config_prefix = cache.oslo {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.debug_cache_backend = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.enable_retry_client = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.enable_socket_keepalive = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.enabled = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.expiration_time = 600 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.hashclient_retry_attempts = 2 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.memcache_dead_retry = 300 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.memcache_pool_maxsize = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.memcache_sasl_enabled = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.password = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.proxies = [] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.redis_db = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.redis_sentinel_service_name = mymaster {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.redis_server = localhost:6379 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.retry_attempts = 2 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.retry_delay = 0.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.socket_keepalive_count = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.socket_keepalive_idle = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.socket_keepalive_interval = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.socket_timeout = 1.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.tls_allowed_ciphers = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.tls_cafile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.tls_certfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.tls_enabled = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.tls_keyfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cache.username = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] coordination.backend_url = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.asyncio_connection = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.asyncio_slave_connection = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.backend = sqlalchemy {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.connection = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.connection_debug = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.connection_parameters = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.connection_recycle_time = 3600 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.connection_trace = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.db_inc_retry_interval = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.db_max_retries = 20 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.db_max_retry_interval = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.db_retry_interval = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.max_overflow = 50 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.max_pool_size = 5 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.max_retries = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.mysql_wsrep_sync_wait = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.pool_timeout = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.retry_interval = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.slave_connection = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.sqlite_synchronous = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.synchronous_reader = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] database.use_db_reconnect = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.connection_string = messaging:// {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.enabled = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.es_doc_type = notification {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.es_scroll_size = 10000 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.es_scroll_time = 2m {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.filter_error_trace = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.hmac_keys = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.sentinel_service_name = mymaster {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.socket_timeout = 0.1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.trace_requests = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler.trace_sqlalchemy = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler_jaeger.process_tags = {} {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler_jaeger.service_name_prefix = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] profiler_otlp.service_name_prefix = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.enforce_new_defaults = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.enforce_scope = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.policy_default_rule = default {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.policy_file = policy.yaml {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_policy.remote_timeout = 60.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] privsep_osbrick.group = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] privsep_osbrick.helper_command = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] privsep_osbrick.user = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cinder_sys_admin.group = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cinder_sys_admin.helper_command = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86416]: DEBUG cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86416) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 04:56:18 devstack cinder-volume[86416]: WARNING cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] cinder_sys_admin.user = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_user.auth_section = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_user.auth_type = password {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_user.cafile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_user.certfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_user.collect_timing = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_user.insecure = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_user.keyfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_user.send_service_user_token = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_user.split_loggers = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] service_user.timeout = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance.auth_section = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance.auth_type = password {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86416]: WARNING cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance.certfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance.collect_timing = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance.insecure = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Running cmd (subprocess): mount.quobyte {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance.keyfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance.region_name = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance.split_loggers = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] glance.timeout = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.backend_availability_zone = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.chap_password = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.chap_username = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.disk_geometry = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.driver_client_cert = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.driver_client_cert_key = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.driver_data_namespace = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.driver_use_ssl = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.enable_unsupported_driver = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.extra_capabilities = {} {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.filter_function = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.goodness_function = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.iscsi_target_flags = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.iscsi_write_cache = on {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.iser_helper = tgtadm {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.iser_ip_address = 192.168.122.130 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.iser_port = 3260 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nas_host = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nas_login = admin {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nas_mount_options = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nas_password = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nas_private_key = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nas_share_path = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nas_ssh_port = 22 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.num_shell_tries = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.nvmet_port_id = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.quobyte_client_cfg = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.quobyte_volume_url = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.replication_device = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.report_discard_supported = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.reserved_percentage = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.scst_target_driver = iscsi {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.scst_target_iqn_name = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.storage_protocol = iSCSI {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.target_helper = tgtadm {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.target_ip_address = 192.168.122.130 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.target_port = 3260 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.target_protocol = iscsi {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.trace_flags = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.unique_fqdn_network = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.use_chap_auth = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.volume_backend_name = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.volume_clear = zero {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.volume_clear_ionice = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.volume_clear_size = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_reports.file_event_handler = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_reports.log_dir = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.backend_availability_zone = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.backend_host = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.chap_password = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.chap_username = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.chiscsi_conf = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.disk_geometry = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.driver_client_cert = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.driver_client_cert_key = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.driver_data_namespace = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.driver_use_ssl = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.extra_capabilities = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.filter_function = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.goodness_function = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.iscsi_target_flags = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.iscsi_write_cache = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.iser_helper = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.iser_ip_address = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.iser_port = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.iser_target_prefix = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nas_host = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nas_login = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nas_mount_options = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nas_password = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nas_private_key = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nas_share_path = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nas_ssh_port = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.num_shell_tries = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nvmet_ns_id = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.nvmet_port_id = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.replication_device = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.report_discard_supported = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.reserved_percentage = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.scst_target_driver = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.storage_protocol = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.target_helper = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.target_ip_address = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.target_port = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.target_prefix = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.target_protocol = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.trace_flags = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.unique_fqdn_network = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.use_chap_auth = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.volume_clear = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.volume_clear_ionice = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.volume_clear_size = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] QuobyteHD.volumes_dir = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.ssl = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.ssl_version = {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_notifications.driver = [] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_notifications.retry = -1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] oslo_messaging_notifications.transport_url = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] key_manager.fixed_key = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.barbican_api_version = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.barbican_endpoint = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.barbican_endpoint_type = public {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.barbican_region_name = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.cafile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.certfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.collect_timing = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.insecure = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.keyfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.number_of_retries = 60 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.retry_delay = 1 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.send_service_user_token = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.split_loggers = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.timeout = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.verify_ssl = True {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican.verify_ssl_path = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican_service_user.auth_section = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican_service_user.auth_type = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican_service_user.cafile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican_service_user.certfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican_service_user.collect_timing = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican_service_user.insecure = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican_service_user.keyfile = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican_service_user.split_loggers = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] barbican_service_user.timeout = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.approle_role_id = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.approle_secret_id = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.kv_mountpoint = secret {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.kv_path = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.kv_version = 2 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.namespace = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.root_token_id = **** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.ssl_ca_crt_file = None {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.timeout = 60.0 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.use_ssl = False {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:18 devstack quobyte-client[86421]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 04:56:19 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:19 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] ******************************************************************************** {{(pid=86169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 04:56:18 devstack quobyte-client[86421]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 04:56:19 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] CMD "mount.quobyte" returned: 1 in 0.137s {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:56:19 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:56:19 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:56:19 devstack cinder-volume[86416]: DEBUG cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=86416) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:56:19 devstack cinder-volume[86416]: INFO cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b ... Jul 09 04:56:19 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 -c /etc/quobyte/client-cinder.cfg {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:56:19 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 -c /etc/quobyte/client-cinder.cfg Jul 09 04:56:19 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:56:19 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Jul 09 04:56:19 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.769s {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:56:19 devstack cinder-volume[86416]: INFO cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b succeeded Jul 09 04:56:19 devstack cinder-volume[86416]: DEBUG cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=86416) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:56:19 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.798s {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:56:19 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:56:19 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:56:19 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:56:20 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.630s {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:56:20 devstack cinder-volume[86416]: INFO cinder.volume.driver [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG cinder.volume.driver [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86416) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG oslo_db.sqlalchemy.engines [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86416) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG dbcounter [-] [86416] Writer thread running {{(pid=86416) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG cinder.db.api [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Building query based on filter {{(pid=86416) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG cinder.image.image_utils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86416) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 04:56:20 devstack cinder-volume[86416]: INFO cinder.keymgr.migration [None req-3ae6e31a-fc97-46c5-a3af-11b6ca57d057 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=86416) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=86416) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:56:20 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:56:20 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:56:20 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:56:21 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Jul 09 04:56:21 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.725s {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:56:21 devstack cinder-volume[86416]: DEBUG cinder.manager [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Notifying Schedulers of capabilities ... {{(pid=86416) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:56:21 devstack cinder-volume[86416]: INFO cinder.volume.manager [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Driver initialization completed successfully. Jul 09 04:56:21 devstack cinder-volume[86416]: INFO cinder.manager [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Initiating service 3 cleanup Jul 09 04:56:21 devstack cinder-volume[86416]: INFO cinder.manager [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Service 3 cleanup completed. Jul 09 04:56:21 devstack cinder-volume[86416]: DEBUG cinder.service [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Creating RPC server for service cinder-volume {{(pid=86416) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 04:56:21 devstack cinder-volume[86416]: DEBUG cinder.service [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86416) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 04:56:21 devstack cinder-volume[86416]: INFO cinder.volume.manager [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 04:56:21 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:56:21 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:56:21 devstack cinder-volume[86416]: DEBUG cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=86416) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:56:21 devstack cinder-volume[86416]: DEBUG cinder.volume.drivers.quobyte [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=86416) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:56:21 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:56:21 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:56:21 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:56:21 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:56:22 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Jul 09 04:56:22 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.779s {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:56:22 devstack cinder-volume[86416]: INFO cinder.volume.manager [None req-8c8a0ab6-05de-4ebd-97fc-1decaae46c13 None None] Driver post RPC initialization completed successfully. Jul 09 04:56:26 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-59dddd90-d49d-4519-b990-e4fba3fcfeb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:56:26 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-59dddd90-d49d-4519-b990-e4fba3fcfeb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:56:26 devstack cinder-volume[86416]: DEBUG cinder.volume.drivers.quobyte [None req-59dddd90-d49d-4519-b990-e4fba3fcfeb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=86416) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:56:26 devstack cinder-volume[86416]: DEBUG cinder.volume.drivers.quobyte [None req-59dddd90-d49d-4519-b990-e4fba3fcfeb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=86416) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:56:26 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-59dddd90-d49d-4519-b990-e4fba3fcfeb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86416) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:56:26 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-59dddd90-d49d-4519-b990-e4fba3fcfeb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:56:26 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:56:26 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:56:27 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Jul 09 04:56:27 devstack cinder-volume[86416]: DEBUG oslo_concurrency.processutils [None req-59dddd90-d49d-4519-b990-e4fba3fcfeb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.633s {{(pid=86416) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:56:27 devstack cinder-volume[86416]: DEBUG cinder.manager [None req-59dddd90-d49d-4519-b990-e4fba3fcfeb3 None None] Notifying Schedulers of capabilities ... {{(pid=86416) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:56:27 devstack cinder-volume[86169]: INFO oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Caught SIGTERM, stopping children Jul 09 04:56:27 devstack cinder-volume[86169]: DEBUG oslo_concurrency.lockutils [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Acquiring lock "singleton_lock" {{(pid=86169) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 04:56:27 devstack cinder-volume[86169]: DEBUG oslo_concurrency.lockutils [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Acquired lock "singleton_lock" {{(pid=86169) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 04:56:27 devstack cinder-volume[86169]: DEBUG oslo_concurrency.lockutils [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Releasing lock "singleton_lock" {{(pid=86169) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 04:56:27 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Stop services. {{(pid=86169) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 04:56:27 devstack cinder-volume[86169]: DEBUG oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Killing children. {{(pid=86169) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 04:56:27 devstack cinder-volume[86169]: INFO oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Waiting on 1 children to exit Jul 09 04:56:29 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Acquiring lock "singleton_lock" {{(pid=86416) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 04:56:29 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Acquired lock "singleton_lock" {{(pid=86416) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 04:56:29 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Releasing lock "singleton_lock" {{(pid=86416) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 04:56:29 devstack cinder-volume[86416]: WARNING amqp [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 04:56:29 devstack cinder-volume[86416]: WARNING amqp [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 04:56:29 devstack cinder-volume[86169]: INFO oslo_service.backend._eventlet.service [None req-deee6dfb-d143-4bd2-98c3-ea2bbf8117bc None None] Child 86416 exited with status 0 Jul 09 04:56:30 devstack cinder-volume[86852]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 04:56:30 devstack cinder-volume[86852]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 04:56:30 devstack cinder-volume[86852]: we strongly recommend against using it for new projects. Jul 09 04:56:30 devstack cinder-volume[86852]: If you are already using Eventlet, we recommend migrating to a different Jul 09 04:56:30 devstack cinder-volume[86852]: framework. For more detail see Jul 09 04:56:30 devstack cinder-volume[86852]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 04:56:30 devstack cinder-volume[86852]: import eventlet # noqa Jul 09 04:56:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 04:56:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 04:56:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 04:56:34 devstack cinder-volume[86852]: INFO dbcounter [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Registered counter for database cinder Jul 09 04:56:34 devstack cinder-volume[86852]: DEBUG oslo_db.sqlalchemy.engines [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writer thread running {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 04:56:35 devstack cinder-volume[86852]: INFO cinder.rpc [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 04:56:35 devstack cinder-volume[86852]: INFO cinder.rpc [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_db.sqlalchemy.engines [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:56:35 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Determined volume DB was empty at startup. Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86852) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 04:56:35 devstack cinder-volume[86852]: WARNING stevedore.named [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 04:56:35 devstack cinder-volume[86852]: WARNING castellan.key_manager [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 04:56:35 devstack cinder-volume[86852]: WARNING cinder.keymgr.conf_key_mgr [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 04:56:35 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_db.sqlalchemy.engines [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:56:35 devstack cinder-volume[86852]: INFO oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Starting 1 workers Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Started child 87161 {{(pid=86852) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Full set of CONF: {{(pid=86852) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] ******************************************************************************** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] Configuration options gathered from: {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] ================================================================================ {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] allow_availability_zone_fallback = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] allow_compression_on_image_upload = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] allowed_direct_url_schemes = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] api_rate_limit = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] auth_strategy = keystone {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_availability_zone = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_host = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_stats_polling_interval = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backup_api_class = cinder.backup.api.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[87161]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backup_name_template = backup-%s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backup_use_same_host = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backup_use_temp_snapshot = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] chap_password = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] chap_username = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cinder_internal_tenant_project_id = 5a9b5a91d7d447138907ec5008702b34 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cinder_internal_tenant_user_id = 0c57e45659c745d6856ed78785657873 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cluster = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] compression_format = gzip {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] compute_api_class = cinder.compute.nova.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] config_dir = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] config_source = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] control_exchange = openstack {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] debug = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] default_availability_zone = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] default_group_type = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] default_volume_type = QuobyteHD {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] disk_geometry = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] driver_client_cert = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] driver_client_cert_key = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] driver_data_namespace = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] driver_ssl_cert_path = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] driver_ssl_cert_verify = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] driver_use_ssl = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] enable_new_services = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] enable_unsupported_driver = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] enabled_backends = ['QuobyteHD'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] enforce_multipath_for_image_xfer = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] filter_function = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance_api_insecure = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance_api_servers = ['http://192.168.122.130/image'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance_api_ssl_compression = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance_ca_certificates_file = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance_catalog_info = image:glance:publicURL {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance_certfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance_keyfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance_num_retries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance_request_timeout = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] goodness_function = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] graceful_shutdown_timeout = 5 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] group_api_class = cinder.group.api.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] host = devstack {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] image_compress_on_upload = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] image_conversion_address_space_limit = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] image_conversion_cpu_limit = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] image_conversion_disable = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] image_upload_use_cinder_backend = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] image_upload_use_internal_tenant = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] image_volume_cache_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] image_volume_cache_max_count = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] image_volume_cache_max_size_gb = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] init_host_max_objects_retrieval = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] instance_format = [instance: %(uuid)s] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] iscsi_target_flags = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] iscsi_write_cache = on {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] iser_helper = tgtadm {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] iser_ip_address = 192.168.122.130 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] iser_port = 3260 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] log_color = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] log_config_append = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] log_dir = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] log_file = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] log_options = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] log_rotate_interval = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] log_rotate_interval_type = days {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] log_rotation_type = none {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] max_age = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] max_logfile_count = 30 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] max_logfile_size_mb = 200 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] max_over_subscription_ratio = 20.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] message_reap_interval = 86400 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] message_ttl = 2592000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] migration_create_volume_timeout_secs = 300 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] monkey_patch = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] monkey_patch_modules = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] my_ip = 192.168.122.130 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] no_snapshot_gb_quota = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] num_iser_scan_tries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] num_shell_tries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] num_volume_device_scan_tries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] nvmeof_conn_info_version = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] nvmet_ns_id = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] nvmet_port_id = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] osapi_max_limit = 1000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] osapi_volume_ext_list = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] osapi_volume_listen_port = 8776 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] osapi_volume_use_ssl = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] osapi_volume_workers = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] per_volume_size_limit = -1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] periodic_fuzzy_delay = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] periodic_interval = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] public_endpoint = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] publish_errors = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] quota_backup_gigabytes = 1000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] quota_backups = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] quota_gigabytes = 1000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] quota_groups = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] quota_snapshots = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] quota_volumes = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] rate_limit_burst = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] rate_limit_except_level = CRITICAL {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] rate_limit_interval = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] reinit_driver_count = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] replication_device = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] report_discard_supported = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] report_interval = 120 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] reservation_clean_interval = 86400 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] reservation_expire = 86400 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] reserved_image_namespaces = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] reserved_percentage = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] rpc_response_timeout = 120 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] run_external_periodic_tasks = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] scst_target_driver = iscsi {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] scst_target_iqn_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_down_time = 720 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] shell_completion = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] snapshot_name_template = snapshot-%s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] split_loggers = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] state_path = /opt/stack/data/cinder {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] storage_availability_zone = nova {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] storage_protocol = iSCSI {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] syslog_log_facility = LOG_USER {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] target_helper = lioadm {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] target_ip_address = 192.168.122.130 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] target_port = 3260 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] target_protocol = iscsi {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] target_secondary_ip_addresses = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] trace_flags = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] transport_url = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] until_refresh = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] use_chap_auth = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] use_default_quota_class = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] use_journal = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] use_json = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] use_multipath_for_image_xfer = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] use_stderr = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] use_syslog = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] verify_glance_signatures = enabled {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_api_class = cinder.volume.api.API {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_backend_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_clear = zero {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_clear_ionice = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_clear_size = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_copy_bps_limit = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_dd_blocksize = 1M {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_name_template = volume-%s {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_service_inithost_offload = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volume_usage_audit_period = month {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] zoning_mode = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_concurrency.disable_process_locking = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.auth_section = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87161) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.auth_type = password {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.auth_version = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.cache = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.certfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.include_service_catalog = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.insecure = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.interface = public {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.keyfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_password = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcache_username = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.region_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.service_type = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.130/identity {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.backend = dogpile.cache.null {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.backend_argument = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.backend_expiration_time = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.config_prefix = cache.oslo {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.debug_cache_backend = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.enable_retry_client = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.enable_socket_keepalive = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.expiration_time = 600 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.hashclient_retry_attempts = 2 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.memcache_dead_retry = 300 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.memcache_pool_maxsize = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.memcache_sasl_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.password = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.proxies = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.redis_db = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.redis_server = localhost:6379 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.retry_attempts = 2 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.retry_delay = 0.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.socket_keepalive_count = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.socket_keepalive_idle = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.socket_keepalive_interval = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.socket_timeout = 1.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.tls_allowed_ciphers = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.tls_cafile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.tls_certfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.tls_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.tls_keyfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cache.username = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] coordination.backend_url = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.asyncio_connection = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.asyncio_slave_connection = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.backend = sqlalchemy {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.connection = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.connection_debug = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.connection_parameters = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.connection_recycle_time = 3600 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.connection_trace = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.db_inc_retry_interval = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.db_max_retries = 20 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.db_max_retry_interval = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.db_retry_interval = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.max_overflow = 50 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.max_pool_size = 5 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.max_retries = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.mysql_wsrep_sync_wait = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.pool_timeout = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.retry_interval = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.slave_connection = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.sqlite_synchronous = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.synchronous_reader = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] database.use_db_reconnect = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.connection_string = messaging:// {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.es_doc_type = notification {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.es_scroll_size = 10000 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.es_scroll_time = 2m {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.filter_error_trace = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.hmac_keys = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.sentinel_service_name = mymaster {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.socket_timeout = 0.1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.trace_requests = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler.trace_sqlalchemy = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler_jaeger.process_tags = {} {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler_jaeger.service_name_prefix = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] profiler_otlp.service_name_prefix = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.enforce_new_defaults = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.enforce_scope = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.policy_default_rule = default {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.policy_file = policy.yaml {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] privsep_osbrick.group = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] privsep_osbrick.helper_command = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] privsep_osbrick.user = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cinder_sys_admin.group = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cinder_sys_admin.helper_command = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87161) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 04:56:35 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.quobyte [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 04:56:35 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.quobyte [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] cinder_sys_admin.user = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_user.auth_section = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_user.auth_type = password {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_user.cafile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_user.certfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_user.collect_timing = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_user.insecure = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_user.keyfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Running cmd (subprocess): mount.quobyte {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_user.send_service_user_token = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_user.split_loggers = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] service_user.timeout = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance.auth_section = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance.auth_type = password {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance.certfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance.collect_timing = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance.insecure = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance.keyfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance.region_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance.split_loggers = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] glance.timeout = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.backend_availability_zone = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.chap_password = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.chap_username = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.disk_geometry = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.driver_client_cert = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.driver_client_cert_key = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.driver_data_namespace = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.driver_use_ssl = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.extra_capabilities = {} {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.filter_function = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.goodness_function = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.iscsi_target_flags = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.iscsi_write_cache = on {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.iser_helper = tgtadm {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.iser_ip_address = 192.168.122.130 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.iser_port = 3260 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nas_host = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nas_login = admin {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nas_mount_options = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nas_password = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nas_private_key = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nas_share_path = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.num_shell_tries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.quobyte_volume_url = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.replication_device = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.report_discard_supported = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.reserved_percentage = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.target_helper = tgtadm {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.target_ip_address = 192.168.122.130 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.target_port = 3260 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.target_protocol = iscsi {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.trace_flags = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.unique_fqdn_network = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.use_chap_auth = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.volume_backend_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.volume_clear = zero {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.volume_clear_ionice = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.volume_clear_size = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_reports.file_event_handler = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_reports.log_dir = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.backend_availability_zone = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.backend_host = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.chap_password = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.chap_username = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.chiscsi_conf = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.disk_geometry = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.driver_client_cert = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.driver_data_namespace = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.driver_use_ssl = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.extra_capabilities = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.filter_function = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.goodness_function = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.iser_helper = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.iser_ip_address = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.iser_port = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.iser_target_prefix = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nas_host = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nas_login = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nas_mount_options = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nas_password = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nas_private_key = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nas_share_path = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nas_ssh_port = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.num_shell_tries = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.nvmet_port_id = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack quobyte-client[87164]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.replication_device = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.report_discard_supported = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.reserved_percentage = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.scst_target_driver = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack quobyte-client[87164]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.storage_protocol = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.target_helper = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.target_ip_address = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.target_port = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.target_prefix = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.target_protocol = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.trace_flags = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.use_chap_auth = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.volume_clear = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.volume_clear_size = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] QuobyteHD.volumes_dir = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.ssl = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_notifications.driver = [] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_notifications.retry = -1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] key_manager.fixed_key = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.barbican_api_version = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.barbican_endpoint = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.barbican_endpoint_type = public {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.barbican_region_name = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.cafile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.certfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.collect_timing = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.insecure = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.keyfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.number_of_retries = 60 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.retry_delay = 1 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.send_service_user_token = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.split_loggers = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.timeout = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.verify_ssl = True {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican.verify_ssl_path = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican_service_user.auth_section = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican_service_user.auth_type = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican_service_user.cafile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican_service_user.certfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican_service_user.collect_timing = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican_service_user.insecure = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican_service_user.keyfile = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican_service_user.split_loggers = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] barbican_service_user.timeout = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.approle_role_id = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.approle_secret_id = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.kv_mountpoint = secret {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.kv_path = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.kv_version = 2 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.namespace = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.root_token_id = **** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.ssl_ca_crt_file = None {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.timeout = 60.0 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.use_ssl = False {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 04:56:35 devstack cinder-volume[86852]: DEBUG oslo_service.backend._eventlet.service [None req-b1479a57-2b00-4ed3-9a83-55b5e0de55a6 None None] ******************************************************************************** {{(pid=86852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 04:56:35 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:56:35 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:56:36 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.633s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:56:36 devstack cinder-volume[87161]: INFO cinder.volume.driver [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Driver hasn't implemented _init_vendor_properties() Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG cinder.volume.driver [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87161) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG oslo_db.sqlalchemy.engines [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87161) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writer thread running {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG cinder.db.api [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Building query based on filter {{(pid=87161) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87161) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:56:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:56:36 devstack cinder-volume[87161]: INFO cinder.keymgr.migration [None req-f5b67b45-21bf-4016-8e6e-0980829163b6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 04:56:36 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:56:36 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:56:37 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Jul 09 04:56:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.629s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:56:37 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:56:37 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Driver initialization completed successfully. Jul 09 04:56:37 devstack cinder-volume[87161]: INFO cinder.manager [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Initiating service 3 cleanup Jul 09 04:56:37 devstack cinder-volume[87161]: INFO cinder.manager [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Service 3 cleanup completed. Jul 09 04:56:37 devstack cinder-volume[87161]: DEBUG cinder.service [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Creating RPC server for service cinder-volume {{(pid=87161) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 04:56:37 devstack cinder-volume[87161]: DEBUG cinder.service [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87161) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 04:56:37 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 04:56:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:56:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:56:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:56:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:56:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:56:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:56:37 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:56:37 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:56:38 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Jul 09 04:56:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.636s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:56:38 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-941a302c-1add-461b-967b-c4dcfb83acdd None None] Driver post RPC initialization completed successfully. Jul 09 04:56:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:56:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 6 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 04:56:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 04:56:45 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:56:47 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:56:48 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=3 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:57:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:57:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:57:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:57:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:57:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:57:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:57:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:57:39 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:57:39 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:57:40 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Jul 09 04:57:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.597s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:57:40 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:57:40 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:57:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 6 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 04:57:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Flow 'volume_create_manager' (6202b198-9a47-4929-b8cf-319932c794ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200e7318-7e1d-4a60-b61c-c57dd4ea5a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200e7318-7e1d-4a60-b61c-c57dd4ea5a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-332899569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb80286-1ad6-43a2-8b59-42a9b6574254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06268dcef9f84c339ff17a726df0f754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:58:04Z,use_quota=True,user_id='21948cb2c4a741b087073da23d3707a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f72b9e2-0b53-4daf-b735-556826b3d523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f72b9e2-0b53-4daf-b735-556826b3d523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b819930d-42ca-4f75-9a81-8637c397ea7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b819930d-42ca-4f75-9a81-8637c397ea7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fb80286-1ad6-43a2-8b59-42a9b6574254', 'volume_name': 'volume-9fb80286-1ad6-43a2-8b59-42a9b6574254', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f7eca4-58e7-41da-ae5d-27aba5e0363b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f7eca4-58e7-41da-ae5d-27aba5e0363b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c94ac6-78be-4761-9e03-d2b506de7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:04 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Volume 9fb80286-1ad6-43a2-8b59-42a9b6574254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fb80286-1ad6-43a2-8b59-42a9b6574254', 'volume_size': 1} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-332899569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb80286-1ad6-43a2-8b59-42a9b6574254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06268dcef9f84c339ff17a726df0f754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:58:04Z,use_quota=True,user_id='21948cb2c4a741b087073da23d3707a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Creating volume 9fb80286-1ad6-43a2-8b59-42a9b6574254 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 04:58:04 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 04:58:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:04 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254 1073741824 Jul 09 04:58:04 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:06 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254 1073741824" returned: 0 in 2.170s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:07 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254 Jul 09 04:58:07 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:08 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254" returned: 0 in 1.667s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] <== create_volume: return (3969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 04:58:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.971s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c94ac6-78be-4761-9e03-d2b506de7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb80286-1ad6-43a2-8b59-42a9b6574254', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe24815-db0d-455a-8c84-473d0c148a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:08 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Volume volume-9fb80286-1ad6-43a2-8b59-42a9b6574254 (9fb80286-1ad6-43a2-8b59-42a9b6574254): created successfully Jul 09 04:58:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe24815-db0d-455a-8c84-473d0c148a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Flow 'volume_create_manager' (6202b198-9a47-4929-b8cf-319932c794ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:58:08 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-786c9c0d-4026-4cda-8840-1745e99a9840 tempest-VolumesAdminNegativeTest-695839544 None] Created volume successfully. Jul 09 04:58:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Acquiring lock "cinder-9fb80286-1ad6-43a2-8b59-42a9b6574254-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 04:58:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Lock "cinder-9fb80286-1ad6-43a2-8b59-42a9b6574254-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 04:58:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Acquiring lock "cinder-quobyte-9fb80286-1ad6-43a2-8b59-42a9b6574254" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 04:58:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Lock "cinder-quobyte-9fb80286-1ad6-43a2-8b59-42a9b6574254" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 04:58:10 devstack cinder-volume[87161]: INFO oslo.privsep.daemon [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2p16ooof/privsep.sock'] Jul 09 04:58:10 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2p16ooof/privsep.sock Jul 09 04:58:10 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:11 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 04:58:11 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 04:58:11 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 04:58:11 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 04:58:11 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 04:58:11 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 04:58:11 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 04:58:11 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 04:58:11 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 04:58:12 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 04:58:12 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 04:58:12 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 04:58:12 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 04:58:12 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 04:58:12 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 04:58:12 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 04:58:12 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 04:58:12 devstack cinder-volume[87161]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 04:58:12 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:12 devstack cinder-volume[87161]: INFO oslo.privsep.daemon [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Spawned new privsep daemon via rootwrap Jul 09 04:58:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Accepted privsep connection to /tmp/tmp2p16ooof/privsep.sock {{(pid=87161) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 04:58:12 devstack cinder-volume[87161]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 04:58:12 devstack cinder-volume[87161]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 04:58:12 devstack cinder-volume[87161]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 04:58:12 devstack cinder-volume[87161]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88286 Jul 09 04:58:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[83347fb3-4f80-495f-8423-f35800978591]: (2,) {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 04:58:13 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f90d67-970c-416e-9e70-601783a907c2]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 04:58:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:13 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254 Jul 09 04:58:13 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:13 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254" returned: 0 in 0.934s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:13 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254 Jul 09 04:58:13 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:14 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9fb80286-1ad6-43a2-8b59-42a9b6574254" returned: 0 in 0.827s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Lock "cinder-quobyte-9fb80286-1ad6-43a2-8b59-42a9b6574254" released by "delete_volume" :: held 4.246s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 04:58:14 devstack cinder-volume[87161]: WARNING cinder.quota [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 04:58:14 devstack cinder-volume[87161]: WARNING cinder.quota [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 04:58:14 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Created reservations ['37a96ea2-84d2-432d-a969-73f2a0a1d96a', '0dbbf187-8e19-406d-8cc2-ce7e0f28fd35', 'b58f335b-877a-4e0f-8226-7ec600b86e38', '050a30dd-d5c1-4b9a-a442-140f66936973'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 04:58:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:58:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:58:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:15 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:58:15 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:15 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.963s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:16 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:58:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Deleted volume successfully. Jul 09 04:58:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9c657f2d-bcd5-4675-9fc4-de26227e94f2 tempest-VolumesAdminNegativeTest-695839544 None] Lock "cinder-9fb80286-1ad6-43a2-8b59-42a9b6574254-delete_volume" released by "delete_volume" :: held 5.646s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Flow 'volume_create_manager' (addf2ccc-12e4-479a-9d47-2c6590cec966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733d62bc-8c57-446f-b33f-8e5e9c99e84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733d62bc-8c57-446f-b33f-8e5e9c99e84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-780435325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd81b0af-1832-4505-b813-7c2fd331ef52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf88637b1ac4c2f8a437c88020ceef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:58:17Z,use_quota=True,user_id='c3ac856ffc2e4b39af82fa2b05deefe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987da037-4eca-4346-b795-cc7c0f716b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987da037-4eca-4346-b795-cc7c0f716b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d38eec-e976-469e-9426-04ea6d7ae733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d38eec-e976-469e-9426-04ea6d7ae733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd81b0af-1832-4505-b813-7c2fd331ef52', 'volume_name': 'volume-dd81b0af-1832-4505-b813-7c2fd331ef52', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8bb465-1040-4744-84bb-66e10f08bd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8bb465-1040-4744-84bb-66e10f08bd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85fd5267-d162-42e7-a63a-ecd170059e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:17 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Volume dd81b0af-1832-4505-b813-7c2fd331ef52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd81b0af-1832-4505-b813-7c2fd331ef52', 'volume_size': 1} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-780435325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd81b0af-1832-4505-b813-7c2fd331ef52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf88637b1ac4c2f8a437c88020ceef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:58:17Z,use_quota=True,user_id='c3ac856ffc2e4b39af82fa2b05deefe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Creating volume dd81b0af-1832-4505-b813-7c2fd331ef52 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 04:58:17 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 04:58:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:17 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52 1073741824 Jul 09 04:58:17 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:18 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52 1073741824" returned: 0 in 0.975s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:18 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52 Jul 09 04:58:18 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:18 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52" returned: 0 in 0.746s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 04:58:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85fd5267-d162-42e7-a63a-ecd170059e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd81b0af-1832-4505-b813-7c2fd331ef52', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f6eff0-9de6-41e1-abb7-b4111afe6999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:19 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Volume volume-dd81b0af-1832-4505-b813-7c2fd331ef52 (dd81b0af-1832-4505-b813-7c2fd331ef52): created successfully Jul 09 04:58:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f6eff0-9de6-41e1-abb7-b4111afe6999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Flow 'volume_create_manager' (addf2ccc-12e4-479a-9d47-2c6590cec966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:58:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0d6c4628-2514-499b-ad4d-6aac8fbd35f1 tempest-ServersNegativeTestJSON-1497003560 None] Created volume successfully. Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Flow 'volume_create_manager' (7257cb53-f8ec-4fcd-a782-9566875c2bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9f6c72-5488-463d-a881-19c42c4dd6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9f6c72-5488-463d-a881-19c42c4dd6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-372917492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc6e254-c944-4463-9005-97736bddae21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf88637b1ac4c2f8a437c88020ceef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:58:22Z,use_quota=True,user_id='c3ac856ffc2e4b39af82fa2b05deefe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea58996f-66c8-412d-a300-8e70a6a841e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea58996f-66c8-412d-a300-8e70a6a841e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fc8266-8b25-4e17-ac96-d9b12bf2183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fc8266-8b25-4e17-ac96-d9b12bf2183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc6e254-c944-4463-9005-97736bddae21', 'volume_name': 'volume-0fc6e254-c944-4463-9005-97736bddae21', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84326d6d-8ee2-4ea2-b1d6-7750d11b2dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84326d6d-8ee2-4ea2-b1d6-7750d11b2dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d130417-efd7-47b1-801a-17ace88b45c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:22 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Volume 0fc6e254-c944-4463-9005-97736bddae21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc6e254-c944-4463-9005-97736bddae21', 'volume_size': 1} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-372917492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc6e254-c944-4463-9005-97736bddae21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf88637b1ac4c2f8a437c88020ceef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:58:22Z,use_quota=True,user_id='c3ac856ffc2e4b39af82fa2b05deefe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Creating volume 0fc6e254-c944-4463-9005-97736bddae21 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 04:58:22 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 04:58:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:22 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21 1073741824 Jul 09 04:58:22 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:23 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21 1073741824" returned: 0 in 0.830s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:23 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21 Jul 09 04:58:23 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:23 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21" returned: 0 in 0.658s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 04:58:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d130417-efd7-47b1-801a-17ace88b45c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc6e254-c944-4463-9005-97736bddae21', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec283f0-b2c2-4225-b901-cdae9f22055d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:24 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Volume volume-0fc6e254-c944-4463-9005-97736bddae21 (0fc6e254-c944-4463-9005-97736bddae21): created successfully Jul 09 04:58:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec283f0-b2c2-4225-b901-cdae9f22055d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Flow 'volume_create_manager' (7257cb53-f8ec-4fcd-a782-9566875c2bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:58:24 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-cc96d0ab-25ec-4637-a206-804b1b7558bc tempest-ServersNegativeTestJSON-1497003560 None] Created volume successfully. Jul 09 04:58:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Acquiring lock "cinder-0fc6e254-c944-4463-9005-97736bddae21-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 04:58:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Lock "cinder-0fc6e254-c944-4463-9005-97736bddae21-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 04:58:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Acquiring lock "cinder-quobyte-0fc6e254-c944-4463-9005-97736bddae21" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 04:58:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Lock "cinder-quobyte-0fc6e254-c944-4463-9005-97736bddae21" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 04:58:24 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabb88ce-522a-462c-8dfc-c2bea407d835]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 04:58:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:25 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21 Jul 09 04:58:25 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:25 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21" returned: 0 in 0.780s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:25 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21 Jul 09 04:58:25 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:26 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0fc6e254-c944-4463-9005-97736bddae21" returned: 0 in 0.759s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Lock "cinder-quobyte-0fc6e254-c944-4463-9005-97736bddae21" released by "delete_volume" :: held 1.594s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 04:58:26 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Created reservations ['7b0c93c3-f84e-4510-8100-2a5d8db0f774', '35dfc840-48bf-484f-9651-43c83107aad5', '76977699-affa-4f80-adf3-c30114121b0e', '44f6d021-8a7e-4357-87af-2c0a80f45694'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 04:58:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:58:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:58:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:26 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:58:26 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Acquiring lock "cinder-dd81b0af-1832-4505-b813-7c2fd331ef52-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 04:58:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Lock "cinder-dd81b0af-1832-4505-b813-7c2fd331ef52-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 04:58:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Acquiring lock "cinder-quobyte-dd81b0af-1832-4505-b813-7c2fd331ef52" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 04:58:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Lock "cinder-quobyte-dd81b0af-1832-4505-b813-7c2fd331ef52" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 04:58:27 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4325303f-8b9e-4a36-97d5-61070b8ce9b1]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 04:58:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:27 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52 Jul 09 04:58:27 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:27 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.908s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:27 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:58:27 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Deleted volume successfully. Jul 09 04:58:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fa364855-008b-44ad-b232-3cd86a339016 tempest-ServersNegativeTestJSON-1497003560 None] Lock "cinder-0fc6e254-c944-4463-9005-97736bddae21-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 04:58:28 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52" returned: 0 in 1.042s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:28 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52 Jul 09 04:58:28 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:29 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dd81b0af-1832-4505-b813-7c2fd331ef52" returned: 0 in 0.727s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Lock "cinder-quobyte-dd81b0af-1832-4505-b813-7c2fd331ef52" released by "delete_volume" :: held 1.850s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Created reservations ['cd55675d-f7ac-48c4-b93d-e5320ffbf17b', '8049df25-0b87-4d62-92bd-5b3a9fc8cdec', '5898f655-174d-4fc2-87e7-49cd4a182175', 'ac9e34c2-e815-4719-87ca-9a64e5e4f29f'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:29 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:58:29 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:29 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.748s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:58:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Deleted volume successfully. Jul 09 04:58:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1d9c9d00-0db7-48bb-ad1c-b6a699bef1c3 tempest-ServersNegativeTestJSON-1497003560 None] Lock "cinder-dd81b0af-1832-4505-b813-7c2fd331ef52-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Flow 'volume_create_manager' (84decb18-911b-4e11-a2fa-79a302decd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8a2109-7d94-466d-ae3a-2950f1b1a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8a2109-7d94-466d-ae3a-2950f1b1a890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-221324578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbde3f7c-588b-4333-9498-baaaa1530fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5468ce2393a34bd39c8f0ec60964a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:58:35Z,use_quota=True,user_id='690d092fb9ea40fe8a8f1ce3b17920ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21d06d4-a5d2-43d9-b1b2-8b8d2feaf08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21d06d4-a5d2-43d9-b1b2-8b8d2feaf08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b226ea18-61bc-4c46-83e2-f4caaced4e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b226ea18-61bc-4c46-83e2-f4caaced4e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbde3f7c-588b-4333-9498-baaaa1530fd0', 'volume_name': 'volume-dbde3f7c-588b-4333-9498-baaaa1530fd0', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b3f5ec-9c96-4421-9c9f-22147671e43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b3f5ec-9c96-4421-9c9f-22147671e43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915f8294-a227-40c0-922e-c8bc79ab88a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Volume dbde3f7c-588b-4333-9498-baaaa1530fd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbde3f7c-588b-4333-9498-baaaa1530fd0', 'volume_size': 1} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-221324578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbde3f7c-588b-4333-9498-baaaa1530fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5468ce2393a34bd39c8f0ec60964a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:58:35Z,use_quota=True,user_id='690d092fb9ea40fe8a8f1ce3b17920ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Creating volume dbde3f7c-588b-4333-9498-baaaa1530fd0 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 04:58:34 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 04:58:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:34 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 1073741824 Jul 09 04:58:34 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:35 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 1073741824" returned: 0 in 1.054s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:35 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 Jul 09 04:58:35 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:36 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0" returned: 0 in 1.028s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 04:58:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915f8294-a227-40c0-922e-c8bc79ab88a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbde3f7c-588b-4333-9498-baaaa1530fd0', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ddbfa3-e81c-44a1-bd4e-76d689459f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:37 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Volume volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 (dbde3f7c-588b-4333-9498-baaaa1530fd0): created successfully Jul 09 04:58:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ddbfa3-e81c-44a1-bd4e-76d689459f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Flow 'volume_create_manager' (84decb18-911b-4e11-a2fa-79a302decd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:58:37 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3bd2ecaf-c898-439d-b7bc-4b8bf33a8d10 tempest-AttachVolumeNegativeTest-58469403 None] Created volume successfully. Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:39 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:58:39 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Flow 'volume_create_manager' (0d67eba9-937a-49f5-98d0-91eb52d096cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081c28f1-c670-4c40-a957-81dd1c767cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081c28f1-c670-4c40-a957-81dd1c767cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1575576351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58dc19b-2787-40f4-a535-412456f035ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7bd66f0a4b42e0bc389b734337c2b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:58:39Z,use_quota=True,user_id='a1c6ee1856434cb1a6d93438b20a4efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f337f39-987a-4bb4-a688-c634cf781d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f337f39-987a-4bb4-a688-c634cf781d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3479c68-f576-4b5f-8006-1f6333814ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3479c68-f576-4b5f-8006-1f6333814ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58dc19b-2787-40f4-a535-412456f035ec', 'volume_name': 'volume-d58dc19b-2787-40f4-a535-412456f035ec', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92dd640-a68c-4a51-86ba-4812c6628710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92dd640-a68c-4a51-86ba-4812c6628710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd9d3a6-ab44-4a2c-9b7b-0620eb80bb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:39 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Volume d58dc19b-2787-40f4-a535-412456f035ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58dc19b-2787-40f4-a535-412456f035ec', 'volume_size': 1} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1575576351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58dc19b-2787-40f4-a535-412456f035ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7bd66f0a4b42e0bc389b734337c2b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:58:39Z,use_quota=True,user_id='a1c6ee1856434cb1a6d93438b20a4efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Creating volume d58dc19b-2787-40f4-a535-412456f035ec {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 04:58:39 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 04:58:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:39 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec 1073741824 Jul 09 04:58:39 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:40 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.036s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:40 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:58:40 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:58:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 8 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 04:58:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 04:58:40 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec 1073741824" returned: 0 in 1.192s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:40 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec Jul 09 04:58:40 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:42 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec" returned: 0 in 1.160s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] <== create_volume: return (2434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 04:58:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.438s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd9d3a6-ab44-4a2c-9b7b-0620eb80bb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58dc19b-2787-40f4-a535-412456f035ec', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d50215-1d58-4751-9a9d-23280babb8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:58:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Volume volume-d58dc19b-2787-40f4-a535-412456f035ec (d58dc19b-2787-40f4-a535-412456f035ec): created successfully Jul 09 04:58:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d50215-1d58-4751-9a9d-23280babb8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:58:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Flow 'volume_create_manager' (0d67eba9-937a-49f5-98d0-91eb52d096cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:58:42 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7536b3dd-b58c-403e-af6f-b65298f8e5a1 tempest-DeleteServersTestJSON-2060140581 None] Created volume successfully. Jul 09 04:58:44 devstack cinder-volume[87161]: WARNING py.warnings [req-e17ec7d9-7c24-4c52-98f4-bfc22ea0572d req-4c8789d5-2167-43a5-bc25-9cab0c251aee tempest-AttachVolumeNegativeTest-58469403 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 09 04:58:44 devstack cinder-volume[87161]: .first() Jul 09 04:58:44 devstack cinder-volume[87161]: Jul 09 04:58:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-e17ec7d9-7c24-4c52-98f4-bfc22ea0572d req-4c8789d5-2167-43a5-bc25-9cab0c251aee tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-e17ec7d9-7c24-4c52-98f4-bfc22ea0572d req-4c8789d5-2167-43a5-bc25-9cab0c251aee tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:44 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e67c12-78ba-40c2-9a36-7319943aa2a8]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 04:58:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-e17ec7d9-7c24-4c52-98f4-bfc22ea0572d req-4c8789d5-2167-43a5-bc25-9cab0c251aee tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:45 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 Jul 09 04:58:45 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:46 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-e17ec7d9-7c24-4c52-98f4-bfc22ea0572d req-4c8789d5-2167-43a5-bc25-9cab0c251aee tempest-AttachVolumeNegativeTest-58469403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0" returned: 0 in 1.183s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-e17ec7d9-7c24-4c52-98f4-bfc22ea0572d req-4c8789d5-2167-43a5-bc25-9cab0c251aee tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.207s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-e17ec7d9-7c24-4c52-98f4-bfc22ea0572d req-4c8789d5-2167-43a5-bc25-9cab0c251aee tempest-AttachVolumeNegativeTest-58469403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-dbde3f7c-588b-4333-9498-baaaa1530fd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09c4311e-fa1c-4d76-b322-bb04bbfa3861', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 04:58:46 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-e17ec7d9-7c24-4c52-98f4-bfc22ea0572d req-4c8789d5-2167-43a5-bc25-9cab0c251aee tempest-AttachVolumeNegativeTest-58469403 None] attachment_update completed successfully. Jul 09 04:58:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-50140d63-3c75-4bd4-bfeb-6222d35c68ac req-f8e1a8a3-d642-4e85-acab-a125fd35aaf6 tempest-DeleteServersTestJSON-2060140581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:58:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-50140d63-3c75-4bd4-bfeb-6222d35c68ac req-f8e1a8a3-d642-4e85-acab-a125fd35aaf6 tempest-DeleteServersTestJSON-2060140581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:58:47 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2827ec-fdd7-4fa6-94d5-09d17ca9b201]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 04:58:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-50140d63-3c75-4bd4-bfeb-6222d35c68ac req-f8e1a8a3-d642-4e85-acab-a125fd35aaf6 tempest-DeleteServersTestJSON-2060140581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:58:47 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec Jul 09 04:58:47 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:58:48 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Jul 09 04:58:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-50140d63-3c75-4bd4-bfeb-6222d35c68ac req-f8e1a8a3-d642-4e85-acab-a125fd35aaf6 tempest-DeleteServersTestJSON-2060140581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec" returned: 0 in 1.175s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:58:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-50140d63-3c75-4bd4-bfeb-6222d35c68ac req-f8e1a8a3-d642-4e85-acab-a125fd35aaf6 tempest-DeleteServersTestJSON-2060140581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.230s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:58:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-50140d63-3c75-4bd4-bfeb-6222d35c68ac req-f8e1a8a3-d642-4e85-acab-a125fd35aaf6 tempest-DeleteServersTestJSON-2060140581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-d58dc19b-2787-40f4-a535-412456f035ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea6e0e7d-4313-4471-b9cd-f81fa2864004', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 04:58:48 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-50140d63-3c75-4bd4-bfeb-6222d35c68ac req-f8e1a8a3-d642-4e85-acab-a125fd35aaf6 tempest-DeleteServersTestJSON-2060140581 None] attachment_update completed successfully. Jul 09 04:58:58 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=37,cinder:UPDATE=41,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:58:58 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=36,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:59:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-d95f880a-8a33-4ff5-9e63-6de406160abe req-1a0e7e5d-5b49-4888-a0a4-f5e4713f9026 tempest-DeleteServersTestJSON-2060140581 None] Terminate volume connection completed successfully. Jul 09 04:59:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-d95f880a-8a33-4ff5-9e63-6de406160abe req-1a0e7e5d-5b49-4888-a0a4-f5e4713f9026 tempest-DeleteServersTestJSON-2060140581 None] Deleting attachment ea6e0e7d-4313-4471-b9cd-f81fa2864004. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 04:59:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Acquiring lock "cinder-d58dc19b-2787-40f4-a535-412456f035ec-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 04:59:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Lock "cinder-d58dc19b-2787-40f4-a535-412456f035ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 04:59:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Acquiring lock "cinder-quobyte-d58dc19b-2787-40f4-a535-412456f035ec" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 04:59:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Lock "cinder-quobyte-d58dc19b-2787-40f4-a535-412456f035ec" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 04:59:05 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f8ad3b-faf1-4a1f-845f-1da7f7ff104d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 04:59:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:59:05 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec Jul 09 04:59:05 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:59:06 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Jul 09 04:59:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec" returned: 0 in 1.021s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:59:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:59:06 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec Jul 09 04:59:06 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:59:07 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Jul 09 04:59:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d58dc19b-2787-40f4-a535-412456f035ec" returned: 0 in 0.735s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:59:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Lock "cinder-quobyte-d58dc19b-2787-40f4-a535-412456f035ec" released by "delete_volume" :: held 1.812s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 04:59:07 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Created reservations ['55ce73a9-758a-47c2-9ec5-5009307526c7', 'da7c5baf-6f1a-4f28-8ea3-1537c7182887', '985b18c0-f4bd-41f7-b70a-6b84a9246df3', '0de38526-eeaa-4b5b-ba05-d8af8748a66b'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 04:59:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:59:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:59:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:59:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:59:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:59:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:59:07 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:59:07 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:59:08 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Jul 09 04:59:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.961s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:59:08 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:59:08 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Deleted volume successfully. Jul 09 04:59:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-50df2a17-cd13-48c0-a8b4-8b06d13bd089 tempest-DeleteServersTestJSON-2060140581 None] Lock "cinder-d58dc19b-2787-40f4-a535-412456f035ec-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Flow 'volume_create_manager' (94bb6217-a748-4f50-8042-d53d7082c8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf32592b-c685-4280-afad-a7da9d6b890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf32592b-c685-4280-afad-a7da9d6b890f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-53278855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c2c589-c50a-4e76-9c2c-06f6024f01aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51969e087bef4aebae2cc5eb14201a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:59:18Z,use_quota=True,user_id='ede945b611804df4b2fe9fade80cf1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cb4e89-5022-4434-beee-3b3de5206109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cb4e89-5022-4434-beee-3b3de5206109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6072e05-dbe5-4c7a-88f0-d9157232c5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6072e05-dbe5-4c7a-88f0-d9157232c5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c2c589-c50a-4e76-9c2c-06f6024f01aa', 'volume_name': 'volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51355a3c-76ae-40d8-854d-25d950cc972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51355a3c-76ae-40d8-854d-25d950cc972b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5634037-4daf-44df-96fa-1afa585698a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:17 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Volume 65c2c589-c50a-4e76-9c2c-06f6024f01aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa', 'volume_size': 1} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-53278855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c2c589-c50a-4e76-9c2c-06f6024f01aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51969e087bef4aebae2cc5eb14201a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:59:18Z,use_quota=True,user_id='ede945b611804df4b2fe9fade80cf1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Creating volume 65c2c589-c50a-4e76-9c2c-06f6024f01aa {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 04:59:17 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 04:59:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:59:17 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa 1073741824 Jul 09 04:59:17 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:59:19 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Jul 09 04:59:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa 1073741824" returned: 0 in 1.278s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:59:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:59:19 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa Jul 09 04:59:19 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:59:20 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Jul 09 04:59:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa" returned: 0 in 1.073s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:59:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] <== create_volume: return (2400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 04:59:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.403s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:59:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5634037-4daf-44df-96fa-1afa585698a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650f08b3-5531-4bd6-9da2-3e017379acc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:20 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Volume volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa (65c2c589-c50a-4e76-9c2c-06f6024f01aa): created successfully Jul 09 04:59:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650f08b3-5531-4bd6-9da2-3e017379acc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Flow 'volume_create_manager' (94bb6217-a748-4f50-8042-d53d7082c8ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:59:20 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0edeaa6a-7912-4225-81e1-66b34c0fd9eb tempest-TaggedAttachmentsTest-2141727094 None] Created volume successfully. Jul 09 04:59:30 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:59:30 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:59:39 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 04:59:39 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:59:39 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.667s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 8 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 04:59:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Flow 'volume_create_manager' (3125a61c-00b4-4e79-8798-7395f3b704cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36514419-bf76-43ae-946d-6d6cae84ed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36514419-bf76-43ae-946d-6d6cae84ed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-670787477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e6102e-c817-47dc-a74a-540ddfb4f892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a8a83a18944fd0af33f70816e9e575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:59:54Z,use_quota=True,user_id='412ca8007bf340d28f7555ee50af8e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb4dbd3-a83c-4a46-afba-440be53e65e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb4dbd3-a83c-4a46-afba-440be53e65e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e6bdc1-740b-47ba-b702-83c467e45f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e6bdc1-740b-47ba-b702-83c467e45f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e6102e-c817-47dc-a74a-540ddfb4f892', 'volume_name': 'volume-17e6102e-c817-47dc-a74a-540ddfb4f892', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d6b223-1ee5-4802-9c1f-8625218d7d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d6b223-1ee5-4802-9c1f-8625218d7d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3fe98d-07d4-45e7-b3af-b4bfa89e9a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:54 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Volume 17e6102e-c817-47dc-a74a-540ddfb4f892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e6102e-c817-47dc-a74a-540ddfb4f892', 'volume_size': 1} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T02:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-670787477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e6102e-c817-47dc-a74a-540ddfb4f892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a8a83a18944fd0af33f70816e9e575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T02:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T02:59:54Z,use_quota=True,user_id='412ca8007bf340d28f7555ee50af8e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Creating volume 17e6102e-c817-47dc-a74a-540ddfb4f892 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 04:59:54 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 04:59:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:59:54 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892 1073741824 Jul 09 04:59:54 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:59:55 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Jul 09 04:59:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892 1073741824" returned: 0 in 1.192s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:59:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 04:59:55 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892 Jul 09 04:59:55 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 04:59:56 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Jul 09 04:59:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892" returned: 0 in 1.031s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 04:59:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] <== create_volume: return (2302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 04:59:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 04:59:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3fe98d-07d4-45e7-b3af-b4bfa89e9a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e6102e-c817-47dc-a74a-540ddfb4f892', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8fd9b0-3389-41bf-8529-b38977471ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 04:59:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Volume volume-17e6102e-c817-47dc-a74a-540ddfb4f892 (17e6102e-c817-47dc-a74a-540ddfb4f892): created successfully Jul 09 04:59:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8fd9b0-3389-41bf-8529-b38977471ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 04:59:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Flow 'volume_create_manager' (3125a61c-00b4-4e79-8798-7395f3b704cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 04:59:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-612edc66-5482-4abd-8435-0c4042ebf57b tempest-AttachVolumeShelveTestJSON-970621556 None] Created volume successfully. Jul 09 04:59:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-e43a01af-4c48-4c38-b6f6-d2d854729ab8 req-0741f710-a975-4344-84de-8ad2889dbff6 tempest-AttachVolumeNegativeTest-58469403 None] Terminate volume connection completed successfully. Jul 09 04:59:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-e43a01af-4c48-4c38-b6f6-d2d854729ab8 req-0741f710-a975-4344-84de-8ad2889dbff6 tempest-AttachVolumeNegativeTest-58469403 None] Deleting attachment 09c4311e-fa1c-4d76-b322-bb04bbfa3861. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:00:06 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:00:09 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=4,cinder:SELECT=4 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:00:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6e8f6fd4-70fd-4b44-aebe-0ac2a2b8fee3 req-43db4bfc-6900-4a5a-905f-6569ca6d65e2 tempest-AttachVolumeShelveTestJSON-970621556 None] No connector for attachment 48df4dee-b730-42f2-99a9-585d5e27722d; skipping storage backend terminate_connection call. {{(pid=87161) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 05:00:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6e8f6fd4-70fd-4b44-aebe-0ac2a2b8fee3 req-43db4bfc-6900-4a5a-905f-6569ca6d65e2 tempest-AttachVolumeShelveTestJSON-970621556 None] Deleting attachment 48df4dee-b730-42f2-99a9-585d5e27722d. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Flow 'volume_create_manager' (e4e5c30a-3ce0-4bed-90fe-4719fd019039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77807473-78f2-42d6-9ce2-99a6c6ece22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77807473-78f2-42d6-9ce2-99a6c6ece22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-812307208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847dfd05-bba7-4cd7-b4c5-dece7a8582d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d04f77b0c7141269131950d03d53f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:00:17Z,use_quota=True,user_id='f2b36ee6c5964cc29e8e4f82f848576c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30388a9e-54c8-438e-ab7f-a94cb5b86df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30388a9e-54c8-438e-ab7f-a94cb5b86df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aabd7b3-b4d4-4721-8d41-dbfe7f7a7200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aabd7b3-b4d4-4721-8d41-dbfe7f7a7200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '847dfd05-bba7-4cd7-b4c5-dece7a8582d3', 'volume_name': 'volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a3f9d7-9659-4c88-b6a3-ceaee961ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a3f9d7-9659-4c88-b6a3-ceaee961ba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a8374b-011c-4bbf-bbc7-41e2aa80a13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:16 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Volume 847dfd05-bba7-4cd7-b4c5-dece7a8582d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3', 'volume_size': 1} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-812307208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847dfd05-bba7-4cd7-b4c5-dece7a8582d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d04f77b0c7141269131950d03d53f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:00:17Z,use_quota=True,user_id='f2b36ee6c5964cc29e8e4f82f848576c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Creating volume 847dfd05-bba7-4cd7-b4c5-dece7a8582d3 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:00:16 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:00:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:00:16 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 1073741824 Jul 09 05:00:16 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:00:17 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Jul 09 05:00:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 1073741824" returned: 0 in 1.070s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:00:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:00:17 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 Jul 09 05:00:17 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:00:18 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Jul 09 05:00:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3" returned: 0 in 0.734s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:00:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:00:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:00:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a8374b-011c-4bbf-bbc7-41e2aa80a13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574d48ae-5b1b-4dea-af19-30fb145a94ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:18 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Volume volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 (847dfd05-bba7-4cd7-b4c5-dece7a8582d3): created successfully Jul 09 05:00:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574d48ae-5b1b-4dea-af19-30fb145a94ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Flow 'volume_create_manager' (e4e5c30a-3ce0-4bed-90fe-4719fd019039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:00:18 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-50207ee7-6155-49b3-87d0-0dad633b987e tempest-ServerActionsTestOtherA-1368884110 None] Created volume successfully. Jul 09 05:00:28 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:00:28 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:00:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-09014957-4322-4c0a-8cbe-89ac28ea2a24 req-93d89b8d-4009-41e2-b75d-bec3fcb0b626 tempest-TaggedAttachmentsTest-2141727094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:00:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-09014957-4322-4c0a-8cbe-89ac28ea2a24 req-93d89b8d-4009-41e2-b75d-bec3fcb0b626 tempest-TaggedAttachmentsTest-2141727094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:00:31 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8e28fa-8396-49dc-b912-1ea32297cbfc]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:00:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-09014957-4322-4c0a-8cbe-89ac28ea2a24 req-93d89b8d-4009-41e2-b75d-bec3fcb0b626 tempest-TaggedAttachmentsTest-2141727094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:00:31 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa Jul 09 05:00:31 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:00:32 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Jul 09 05:00:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-09014957-4322-4c0a-8cbe-89ac28ea2a24 req-93d89b8d-4009-41e2-b75d-bec3fcb0b626 tempest-TaggedAttachmentsTest-2141727094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa" returned: 0 in 1.199s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:00:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-09014957-4322-4c0a-8cbe-89ac28ea2a24 req-93d89b8d-4009-41e2-b75d-bec3fcb0b626 tempest-TaggedAttachmentsTest-2141727094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.240s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:00:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-09014957-4322-4c0a-8cbe-89ac28ea2a24 req-93d89b8d-4009-41e2-b75d-bec3fcb0b626 tempest-TaggedAttachmentsTest-2141727094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c32b63d0-bb6a-4a5d-908e-f38eb9b4c39b', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:00:32 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-09014957-4322-4c0a-8cbe-89ac28ea2a24 req-93d89b8d-4009-41e2-b75d-bec3fcb0b626 tempest-TaggedAttachmentsTest-2141727094 None] attachment_update completed successfully. Jul 09 05:00:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:00:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:00:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:00:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:00:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:00:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:00:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:00:39 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:00:39 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:00:40 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Jul 09 05:00:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.404s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:00:40 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:00:41 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-119aaa57-6798-4606-9677-dccf14fe7703 req-ce156f1b-d1bc-46c8-b167-c40e2ad7b816 tempest-TaggedAttachmentsTest-2141727094 None] Terminate volume connection completed successfully. Jul 09 05:00:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-119aaa57-6798-4606-9677-dccf14fe7703 req-ce156f1b-d1bc-46c8-b167-c40e2ad7b816 tempest-TaggedAttachmentsTest-2141727094 None] Deleting attachment c32b63d0-bb6a-4a5d-908e-f38eb9b4c39b. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:00:51 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:00:51 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Flow 'volume_create_manager' (75677878-4fdd-4e17-a333-c11552335fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517bab65-c57d-4b29-8d02-8ff7635232b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517bab65-c57d-4b29-8d02-8ff7635232b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-736972277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662172d8-c18c-4fe1-92d7-73248dddd057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5468ce2393a34bd39c8f0ec60964a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:00:57Z,use_quota=True,user_id='690d092fb9ea40fe8a8f1ce3b17920ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502b53b2-21b9-47e2-b91e-802f3d0756f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502b53b2-21b9-47e2-b91e-802f3d0756f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799f5ab4-66b1-4461-a4ed-b858d63dbd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799f5ab4-66b1-4461-a4ed-b858d63dbd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662172d8-c18c-4fe1-92d7-73248dddd057', 'volume_name': 'volume-662172d8-c18c-4fe1-92d7-73248dddd057', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9354db-1282-4fe5-82ae-e70346d4e15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9354db-1282-4fe5-82ae-e70346d4e15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1116979a-b833-4739-8864-a9c2ee4d637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:57 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Volume 662172d8-c18c-4fe1-92d7-73248dddd057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662172d8-c18c-4fe1-92d7-73248dddd057', 'volume_size': 1} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-736972277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662172d8-c18c-4fe1-92d7-73248dddd057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5468ce2393a34bd39c8f0ec60964a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:00:57Z,use_quota=True,user_id='690d092fb9ea40fe8a8f1ce3b17920ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Creating volume 662172d8-c18c-4fe1-92d7-73248dddd057 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:00:57 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:00:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:00:57 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 1073741824 Jul 09 05:00:57 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:00:58 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Jul 09 05:00:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 1073741824" returned: 0 in 0.870s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:00:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:00:58 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 Jul 09 05:00:58 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:00:58 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Jul 09 05:00:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057" returned: 0 in 0.727s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:00:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:00:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:00:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1116979a-b833-4739-8864-a9c2ee4d637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662172d8-c18c-4fe1-92d7-73248dddd057', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbbf535-0d0e-4300-bfbf-fcb0c33866d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:00:58 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Volume volume-662172d8-c18c-4fe1-92d7-73248dddd057 (662172d8-c18c-4fe1-92d7-73248dddd057): created successfully Jul 09 05:00:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbbf535-0d0e-4300-bfbf-fcb0c33866d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:00:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Flow 'volume_create_manager' (75677878-4fdd-4e17-a333-c11552335fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:00:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-46139788-f3c0-4b43-9c46-dd2d10c5369a tempest-AttachVolumeNegativeTest-58469403 None] Created volume successfully. Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Acquiring lock "cinder-65c2c589-c50a-4e76-9c2c-06f6024f01aa-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Lock "cinder-65c2c589-c50a-4e76-9c2c-06f6024f01aa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Acquiring lock "cinder-quobyte-65c2c589-c50a-4e76-9c2c-06f6024f01aa" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Lock "cinder-quobyte-65c2c589-c50a-4e76-9c2c-06f6024f01aa" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8495ca1-6e70-404b-8ef8-b8638e5a4b7c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:01:02 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa Jul 09 05:01:02 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6f365daf-3069-490e-9bc9-f1dc0628b1aa req-4bc8e462-4a34-4bda-99e1-1ea94e349a59 tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6f365daf-3069-490e-9bc9-f1dc0628b1aa req-4bc8e462-4a34-4bda-99e1-1ea94e349a59 tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b868f2-6b6c-4599-8629-d84bb66dd568]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6f365daf-3069-490e-9bc9-f1dc0628b1aa req-4bc8e462-4a34-4bda-99e1-1ea94e349a59 tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:01:02 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 Jul 09 05:01:02 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:01:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ce8be538-ceaf-4d3e-a7ed-1b29c058ffa7 req-29771479-1918-4ad9-9b55-3377f1c4192d tempest-ServerActionsTestOtherA-1368884110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:01:03 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa" returned: 0 in 0.875s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:01:03 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa Jul 09 05:01:03 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:01:03 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6f365daf-3069-490e-9bc9-f1dc0628b1aa req-4bc8e462-4a34-4bda-99e1-1ea94e349a59 tempest-AttachVolumeNegativeTest-58469403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057" returned: 0 in 0.828s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6f365daf-3069-490e-9bc9-f1dc0628b1aa req-4bc8e462-4a34-4bda-99e1-1ea94e349a59 tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ce8be538-ceaf-4d3e-a7ed-1b29c058ffa7 req-29771479-1918-4ad9-9b55-3377f1c4192d tempest-ServerActionsTestOtherA-1368884110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.332s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c4f3d7-df31-4ae9-bcde-9a15eed3b058]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ce8be538-ceaf-4d3e-a7ed-1b29c058ffa7 req-29771479-1918-4ad9-9b55-3377f1c4192d tempest-ServerActionsTestOtherA-1368884110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6f365daf-3069-490e-9bc9-f1dc0628b1aa req-4bc8e462-4a34-4bda-99e1-1ea94e349a59 tempest-AttachVolumeNegativeTest-58469403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-662172d8-c18c-4fe1-92d7-73248dddd057', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '294eed01-c698-480a-bbe6-62fe5a02468d', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:01:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-6f365daf-3069-490e-9bc9-f1dc0628b1aa req-4bc8e462-4a34-4bda-99e1-1ea94e349a59 tempest-AttachVolumeNegativeTest-58469403 None] attachment_update completed successfully. Jul 09 05:01:03 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 Jul 09 05:01:03 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:01:03 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65c2c589-c50a-4e76-9c2c-06f6024f01aa" returned: 0 in 0.626s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Lock "cinder-quobyte-65c2c589-c50a-4e76-9c2c-06f6024f01aa" released by "delete_volume" :: held 1.577s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Created reservations ['46531e81-af2d-42cf-b140-49a23a5260f8', '81cc3987-dd97-4263-8317-e62a26573fcb', 'ccc6226b-020e-4d44-8496-64435d6c2c17', 'd5faeb43-76a7-402f-8abb-f77bce3c6855'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:01:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:01:03 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:01:03 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:01:04 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Jul 09 05:01:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ce8be538-ceaf-4d3e-a7ed-1b29c058ffa7 req-29771479-1918-4ad9-9b55-3377f1c4192d tempest-ServerActionsTestOtherA-1368884110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3" returned: 0 in 0.790s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:01:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ce8be538-ceaf-4d3e-a7ed-1b29c058ffa7 req-29771479-1918-4ad9-9b55-3377f1c4192d tempest-ServerActionsTestOtherA-1368884110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.818s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:01:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-ce8be538-ceaf-4d3e-a7ed-1b29c058ffa7 req-29771479-1918-4ad9-9b55-3377f1c4192d tempest-ServerActionsTestOtherA-1368884110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a79df40-661d-4a2b-84dc-9b3529a381f6', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:01:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-ce8be538-ceaf-4d3e-a7ed-1b29c058ffa7 req-29771479-1918-4ad9-9b55-3377f1c4192d tempest-ServerActionsTestOtherA-1368884110 None] attachment_update completed successfully. Jul 09 05:01:04 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 09 05:01:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.784s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:01:04 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:01:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Deleted volume successfully. Jul 09 05:01:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7405ae08-4775-44d8-bae0-3227cac287f3 tempest-TaggedAttachmentsTest-2141727094 None] Lock "cinder-65c2c589-c50a-4e76-9c2c-06f6024f01aa-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:01:10 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-4100fb95-ae8d-44b1-9b95-14ab108e7e59 req-aa47615d-0217-421e-b339-7a2bb359c1d8 tempest-AttachVolumeNegativeTest-58469403 None] Terminate volume connection completed successfully. Jul 09 05:01:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-4100fb95-ae8d-44b1-9b95-14ab108e7e59 req-aa47615d-0217-421e-b339-7a2bb359c1d8 tempest-AttachVolumeNegativeTest-58469403 None] Deleting attachment 294eed01-c698-480a-bbe6-62fe5a02468d. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:01:12 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-5c14af27-96af-4b59-9ca7-867db87832e9 req-bbce149e-187e-4fbb-afa4-f9a8a5461120 tempest-ServerActionsTestOtherA-1368884110 None] Terminate volume connection completed successfully. Jul 09 05:01:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-5c14af27-96af-4b59-9ca7-867db87832e9 req-bbce149e-187e-4fbb-afa4-f9a8a5461120 tempest-ServerActionsTestOtherA-1368884110 None] Deleting attachment 9a79df40-661d-4a2b-84dc-9b3529a381f6. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:01:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-5c14af27-96af-4b59-9ca7-867db87832e9 req-18c6a0db-3611-44b1-8e25-dc5a38d076b3 tempest-ServerActionsTestOtherA-1368884110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:01:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-5c14af27-96af-4b59-9ca7-867db87832e9 req-18c6a0db-3611-44b1-8e25-dc5a38d076b3 tempest-ServerActionsTestOtherA-1368884110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:01:14 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb25a3c-53d8-466a-a0fd-301ff502ce16]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:01:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-5c14af27-96af-4b59-9ca7-867db87832e9 req-18c6a0db-3611-44b1-8e25-dc5a38d076b3 tempest-ServerActionsTestOtherA-1368884110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:01:14 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 Jul 09 05:01:14 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:01:15 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Jul 09 05:01:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-5c14af27-96af-4b59-9ca7-867db87832e9 req-18c6a0db-3611-44b1-8e25-dc5a38d076b3 tempest-ServerActionsTestOtherA-1368884110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3" returned: 0 in 1.091s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:01:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-5c14af27-96af-4b59-9ca7-867db87832e9 req-18c6a0db-3611-44b1-8e25-dc5a38d076b3 tempest-ServerActionsTestOtherA-1368884110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.119s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:01:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-5c14af27-96af-4b59-9ca7-867db87832e9 req-18c6a0db-3611-44b1-8e25-dc5a38d076b3 tempest-ServerActionsTestOtherA-1368884110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21f21900-ffc8-47e5-b0f3-a7a73301fdc2', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:01:15 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-5c14af27-96af-4b59-9ca7-867db87832e9 req-18c6a0db-3611-44b1-8e25-dc5a38d076b3 tempest-ServerActionsTestOtherA-1368884110 None] attachment_update completed successfully. Jul 09 05:01:25 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=29,cinder:UPDATE=15,cinder:INSERT=3 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:01:25 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=16,cinder:SELECT=22,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:01:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Acquiring lock "cinder-17e6102e-c817-47dc-a74a-540ddfb4f892-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:01:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Lock "cinder-17e6102e-c817-47dc-a74a-540ddfb4f892-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:01:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Acquiring lock "cinder-quobyte-17e6102e-c817-47dc-a74a-540ddfb4f892" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:01:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Lock "cinder-quobyte-17e6102e-c817-47dc-a74a-540ddfb4f892" acquired by "delete_volume" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:01:26 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b12f93-b907-4a52-9fc2-74a986c3a758]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:01:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:01:26 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892 Jul 09 05:01:26 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:01:27 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Jul 09 05:01:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892" returned: 0 in 1.195s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:01:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:01:27 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892 Jul 09 05:01:27 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:01:28 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 09 05:01:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-17e6102e-c817-47dc-a74a-540ddfb4f892" returned: 0 in 0.784s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:01:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Lock "cinder-quobyte-17e6102e-c817-47dc-a74a-540ddfb4f892" released by "delete_volume" :: held 2.088s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:01:28 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Created reservations ['8dc84fd3-d5e9-411f-97ee-a4756dff87c7', '3c821caa-ac4a-40e4-b30f-f3ec1695cb41', 'db130dca-1f96-484f-a387-99e99e98efc9', '8b2963e5-efc3-4a69-a319-39db98cb2c63'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:01:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:01:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:01:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:01:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:01:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:01:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:01:28 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:01:28 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:01:29 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Jul 09 05:01:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.913s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:01:29 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:01:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Deleted volume successfully. Jul 09 05:01:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5b71101-1651-45b1-9086-28da486fbfe8 tempest-AttachVolumeShelveTestJSON-970621556 None] Lock "cinder-17e6102e-c817-47dc-a74a-540ddfb4f892-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:01:38 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:01:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:01:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 8 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:01:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:01:39 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=9,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:01:50 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-382461c1-14c9-4d1a-9574-31019c84f661 req-907f94f2-ca9c-4bef-8b26-4456439a8cda tempest-ServerActionsTestOtherA-1368884110 None] Terminate volume connection completed successfully. Jul 09 05:01:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-382461c1-14c9-4d1a-9574-31019c84f661 req-907f94f2-ca9c-4bef-8b26-4456439a8cda tempest-ServerActionsTestOtherA-1368884110 None] Deleting attachment 21f21900-ffc8-47e5-b0f3-a7a73301fdc2. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:01:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-249a1f56-9e78-4236-8bee-bd2f18472649 tempest-GroupsTest-1705712103 None] Group tempest-Group1-398284757: creating Jul 09 05:01:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-249a1f56-9e78-4236-8bee-bd2f18472649 tempest-GroupsTest-1705712103 None] Group tempest-Group1-398284757: created successfully Jul 09 05:01:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-249a1f56-9e78-4236-8bee-bd2f18472649 tempest-GroupsTest-1705712103 None] Create group completed successfully. Jul 09 05:02:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d575a977-b003-4547-9f95-a027af02c766 tempest-GroupsTest-1705712103 None] Group tempest-Group2-557449332: creating Jul 09 05:02:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d575a977-b003-4547-9f95-a027af02c766 tempest-GroupsTest-1705712103 None] Group tempest-Group2-557449332: created successfully Jul 09 05:02:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d575a977-b003-4547-9f95-a027af02c766 tempest-GroupsTest-1705712103 None] Create group completed successfully. Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Flow 'volume_create_manager' (b8b78fba-d19e-4225-a4e2-8c18f18509c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001b9914-cd45-4e90-82e4-39ff8a58c336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001b9914-cd45-4e90-82e4-39ff8a58c336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1177670302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe1aafab-0062-4b0a-82a2-8327d2f5c204,host='devstack@QuobyteHD#QuobyteHD',id=b261a432-f03d-43a7-ac23-d8992ce956fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435595b5e5214c90a684f9d840356332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:02Z,use_quota=True,user_id='bbaac1387d514ef2bffeb2158f278688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10f77a0d-79d7-4e41-9b54-620be9263e6d),volume_type_id=10f77a0d-79d7-4e41-9b54-620be9263e6d)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d6cac8-d354-41c5-ad8e-5b8b0a174e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d6cac8-d354-41c5-ad8e-5b8b0a174e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f09a5c-d4f9-436c-9f45-27bb6a2db04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f09a5c-d4f9-436c-9f45-27bb6a2db04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b261a432-f03d-43a7-ac23-d8992ce956fe', 'volume_name': 'volume-b261a432-f03d-43a7-ac23-d8992ce956fe', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77ce922-5817-45ff-8a3f-78e15d4733d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77ce922-5817-45ff-8a3f-78e15d4733d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9624af5d-174c-4807-bbdd-2d11c9275ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:02 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Volume b261a432-f03d-43a7-ac23-d8992ce956fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b261a432-f03d-43a7-ac23-d8992ce956fe', 'volume_size': 1} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe1aafab-0062-4b0a-82a2-8327d2f5c204,created_at=2026-07-09T03:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1177670302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe1aafab-0062-4b0a-82a2-8327d2f5c204,host='devstack@QuobyteHD#QuobyteHD',id=b261a432-f03d-43a7-ac23-d8992ce956fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435595b5e5214c90a684f9d840356332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:02Z,use_quota=True,user_id='bbaac1387d514ef2bffeb2158f278688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10f77a0d-79d7-4e41-9b54-620be9263e6d),volume_type_id=10f77a0d-79d7-4e41-9b54-620be9263e6d)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Creating volume b261a432-f03d-43a7-ac23-d8992ce956fe {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:02:02 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:02:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:02 devstack sudo[92217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe 1073741824 Jul 09 05:02:02 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:03 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe 1073741824" returned: 0 in 1.013s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Acquiring lock "cinder-847dfd05-bba7-4cd7-b4c5-dece7a8582d3-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Lock "cinder-847dfd05-bba7-4cd7-b4c5-dece7a8582d3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:03 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe Jul 09 05:02:03 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Acquiring lock "cinder-quobyte-847dfd05-bba7-4cd7-b4c5-dece7a8582d3" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Lock "cinder-quobyte-847dfd05-bba7-4cd7-b4c5-dece7a8582d3" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8efe77-d540-45e4-8a2b-41b1ca40565b]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:04 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 Jul 09 05:02:04 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:04 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe" returned: 0 in 0.794s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:02:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9624af5d-174c-4807-bbdd-2d11c9275ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b261a432-f03d-43a7-ac23-d8992ce956fe', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fca488-9027-470c-9fb3-f039250b496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:04 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Volume volume-b261a432-f03d-43a7-ac23-d8992ce956fe (b261a432-f03d-43a7-ac23-d8992ce956fe): created successfully Jul 09 05:02:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fca488-9027-470c-9fb3-f039250b496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Flow 'volume_create_manager' (b8b78fba-d19e-4225-a4e2-8c18f18509c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6ff42687-cc3c-461b-bb3d-ff83fab20647 tempest-GroupsTest-1705712103 None] Created volume successfully. Jul 09 05:02:04 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3" returned: 0 in 0.862s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:04 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3 Jul 09 05:02:04 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:05 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-847dfd05-bba7-4cd7-b4c5-dece7a8582d3" returned: 0 in 0.992s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Lock "cinder-quobyte-847dfd05-bba7-4cd7-b4c5-dece7a8582d3" released by "delete_volume" :: held 1.924s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:05 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Created reservations ['4113ec1f-226e-4de2-a342-5faa2563696e', '3f54d575-3d60-4bcd-9c6a-66e166efc921', '7b6dbf70-526a-49d6-9589-870d88c8e930', 'deb41023-ffcc-4b0c-9df7-04f545c6f806'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:06 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:06 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Acquiring lock "cinder-quobyte-b261a432-f03d-43a7-ac23-d8992ce956fe" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Lock "cinder-quobyte-b261a432-f03d-43a7-ac23-d8992ce956fe" acquired by "delete_volume" :: waited 0.068s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:06 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[95da9485-1367-49e2-a9e4-12e373cc0d91]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:06 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe Jul 09 05:02:06 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:07 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.388s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Deleted volume successfully. Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad5c7690-8426-4a67-bbff-7fc1d06102fc tempest-ServerActionsTestOtherA-1368884110 None] Lock "cinder-847dfd05-bba7-4cd7-b4c5-dece7a8582d3-delete_volume" released by "delete_volume" :: held 3.660s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Flow 'volume_create_manager' (2c36d923-708e-4688-8c8f-a4ad1358a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae57df9b-317b-4178-9242-a69139a10bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae57df9b-317b-4178-9242-a69139a10bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-124851035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b897657e-ba44-4ad3-a3af-07cfea406f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d324f01bee42cf90df84ae73e90263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:07Z,use_quota=True,user_id='fa2057d633b5401f8988e46eb63f28ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcb8e2a-f5dc-4985-81a3-afa13d940688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcb8e2a-f5dc-4985-81a3-afa13d940688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e3e9c0-1409-4794-861a-04cd5b6b4673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e3e9c0-1409-4794-861a-04cd5b6b4673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b897657e-ba44-4ad3-a3af-07cfea406f7b', 'volume_name': 'volume-b897657e-ba44-4ad3-a3af-07cfea406f7b', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54866ca1-afa3-43b2-97b2-023d3b5f7669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54866ca1-afa3-43b2-97b2-023d3b5f7669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c4cca8-c5c7-415a-baad-1a53b5ecc695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:07 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Volume b897657e-ba44-4ad3-a3af-07cfea406f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b897657e-ba44-4ad3-a3af-07cfea406f7b', 'volume_size': 1} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-124851035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b897657e-ba44-4ad3-a3af-07cfea406f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d324f01bee42cf90df84ae73e90263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:07Z,use_quota=True,user_id='fa2057d633b5401f8988e46eb63f28ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Creating volume b897657e-ba44-4ad3-a3af-07cfea406f7b {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:02:07 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:02:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:07 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b 1073741824 Jul 09 05:02:07 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:08 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe" returned: 0 in 1.441s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:08 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe Jul 09 05:02:08 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:09 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b 1073741824" returned: 0 in 1.582s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:09 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b Jul 09 05:02:09 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:09 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b261a432-f03d-43a7-ac23-d8992ce956fe" returned: 0 in 1.548s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Lock "cinder-quobyte-b261a432-f03d-43a7-ac23-d8992ce956fe" released by "delete_volume" :: held 3.091s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:09 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Created reservations ['84d2c19c-57b2-4190-abb2-eb236cda0d57'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:09 devstack cinder-volume[87161]: WARNING cinder.quota [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1066042361 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1066042361, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:02:09 devstack cinder-volume[87161]: WARNING cinder.quota [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1066042361 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1066042361, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:02:09 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Created reservations ['df66c97c-4f88-4852-a591-486e036c1fd8', '8edb25f7-c1f7-48ed-b097-9ddebcfe5fe5', '2c011180-82ff-43bf-bb10-9159671ca292', '6a717bc8-cb5a-4a1b-8f1c-a3ead1eebc03'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:10 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:10 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:10 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b" returned: 0 in 1.679s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] <== create_volume: return (3366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:02:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.369s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-efccfd24-b3e5-4d24-b39f-cd88803b61be tempest-GroupsTest-1705712103 None] Created reservations ['304b74fc-c943-45ef-ad88-4d8248fb38df'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c4cca8-c5c7-415a-baad-1a53b5ecc695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b897657e-ba44-4ad3-a3af-07cfea406f7b', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca10e06-fd26-47e7-886f-b81fc9eb9109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Flow 'volume_create_manager' (91b295ff-1f99-4d8a-ac3a-4a1634d8ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b9b1a1-8d08-49d3-951f-2c055753df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Volume volume-b897657e-ba44-4ad3-a3af-07cfea406f7b (b897657e-ba44-4ad3-a3af-07cfea406f7b): created successfully Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca10e06-fd26-47e7-886f-b81fc9eb9109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Flow 'volume_create_manager' (2c36d923-708e-4688-8c8f-a4ad1358a813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b9b1a1-8d08-49d3-951f-2c055753df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1070731731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31c3b1c-afa5-4cfe-9b71-d36158110210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5468ce2393a34bd39c8f0ec60964a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:11Z,use_quota=True,user_id='690d092fb9ea40fe8a8f1ce3b17920ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a8948c-d25d-40f7-9276-f57d86678cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a8948c-d25d-40f7-9276-f57d86678cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bdd1ad-6ddf-4201-9f43-547e9ae771c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bdd1ad-6ddf-4201-9f43-547e9ae771c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31c3b1c-afa5-4cfe-9b71-d36158110210', 'volume_name': 'volume-a31c3b1c-afa5-4cfe-9b71-d36158110210', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d1d55a-35a8-47ec-8345-1043c9a38e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d1d55a-35a8-47ec-8345-1043c9a38e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea3caf2-b545-4185-89a1-05fe15046495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Volume a31c3b1c-afa5-4cfe-9b71-d36158110210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31c3b1c-afa5-4cfe-9b71-d36158110210', 'volume_size': 1} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1070731731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31c3b1c-afa5-4cfe-9b71-d36158110210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5468ce2393a34bd39c8f0ec60964a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:11Z,use_quota=True,user_id='690d092fb9ea40fe8a8f1ce3b17920ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Creating volume a31c3b1c-afa5-4cfe-9b71-d36158110210 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:11 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:02:11 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a742a49b-5c77-40f5-bd74-9e51a8a251b2 tempest-ServerRescueNegativeTestJSON-286126704 None] Created volume successfully. Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.502s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:11 devstack sudo[92311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 1073741824 Jul 09 05:02:11 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-763613c1-7696-4b62-8047-43fed686e74c tempest-GroupsTest-1705712103 None] Delete group completed successfully. Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-efccfd24-b3e5-4d24-b39f-cd88803b61be tempest-GroupsTest-1705712103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-efccfd24-b3e5-4d24-b39f-cd88803b61be tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-efccfd24-b3e5-4d24-b39f-cd88803b61be tempest-GroupsTest-1705712103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-efccfd24-b3e5-4d24-b39f-cd88803b61be tempest-GroupsTest-1705712103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-efccfd24-b3e5-4d24-b39f-cd88803b61be tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-efccfd24-b3e5-4d24-b39f-cd88803b61be tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:11 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:11 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-487e9fcc-d5cb-4030-8dbe-0e81a2a351c9 tempest-GroupsTest-1705712103 None] Group tempest-GroupsTest-Group-520468487: creating Jul 09 05:02:13 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-efccfd24-b3e5-4d24-b39f-cd88803b61be tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.259s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:13 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-efccfd24-b3e5-4d24-b39f-cd88803b61be tempest-GroupsTest-1705712103 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-487e9fcc-d5cb-4030-8dbe-0e81a2a351c9 tempest-GroupsTest-1705712103 None] Group tempest-GroupsTest-Group-520468487: created successfully Jul 09 05:02:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-efccfd24-b3e5-4d24-b39f-cd88803b61be tempest-GroupsTest-1705712103 None] Delete group completed successfully. Jul 09 05:02:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-487e9fcc-d5cb-4030-8dbe-0e81a2a351c9 tempest-GroupsTest-1705712103 None] Create group completed successfully. Jul 09 05:02:13 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 1073741824" returned: 0 in 1.552s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:13 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 Jul 09 05:02:13 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:14 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210" returned: 0 in 0.722s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:02:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea3caf2-b545-4185-89a1-05fe15046495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31c3b1c-afa5-4cfe-9b71-d36158110210', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317fe48e-e7d5-4e18-98f1-9f100ffe3086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:14 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Volume volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 (a31c3b1c-afa5-4cfe-9b71-d36158110210): created successfully Jul 09 05:02:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317fe48e-e7d5-4e18-98f1-9f100ffe3086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Flow 'volume_create_manager' (91b295ff-1f99-4d8a-ac3a-4a1634d8ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:14 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-dd405d49-1000-4925-8451-937940c0e50a tempest-AttachVolumeNegativeTest-58469403 None] Created volume successfully. Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Flow 'volume_create_manager' (2e28c8ed-2e80-4363-ac6f-31d88efbfeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdba69b-5acf-46c2-969e-4f774fb5cb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdba69b-5acf-46c2-969e-4f774fb5cb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1210297259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81dda129-5b95-4962-b403-c4148f8e8bb9,host='devstack@QuobyteHD#QuobyteHD',id=10cc5d4b-8146-4d24-b2b5-b803a2439578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435595b5e5214c90a684f9d840356332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:15Z,use_quota=True,user_id='bbaac1387d514ef2bffeb2158f278688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(252016cb-ac11-4023-8df2-725ce1f66bdd),volume_type_id=252016cb-ac11-4023-8df2-725ce1f66bdd)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5ba155-5504-43c3-96ac-f52468e22d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5ba155-5504-43c3-96ac-f52468e22d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d49406e-c5d1-46dd-88de-cdff74e64a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d49406e-c5d1-46dd-88de-cdff74e64a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10cc5d4b-8146-4d24-b2b5-b803a2439578', 'volume_name': 'volume-10cc5d4b-8146-4d24-b2b5-b803a2439578', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2080fd33-31b9-4ef0-9776-5293c7df9731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2080fd33-31b9-4ef0-9776-5293c7df9731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8f22fe-6647-4215-8694-e016f9edfd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:15 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Volume 10cc5d4b-8146-4d24-b2b5-b803a2439578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10cc5d4b-8146-4d24-b2b5-b803a2439578', 'volume_size': 1} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=81dda129-5b95-4962-b403-c4148f8e8bb9,created_at=2026-07-09T03:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1210297259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81dda129-5b95-4962-b403-c4148f8e8bb9,host='devstack@QuobyteHD#QuobyteHD',id=10cc5d4b-8146-4d24-b2b5-b803a2439578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435595b5e5214c90a684f9d840356332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:15Z,use_quota=True,user_id='bbaac1387d514ef2bffeb2158f278688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(252016cb-ac11-4023-8df2-725ce1f66bdd),volume_type_id=252016cb-ac11-4023-8df2-725ce1f66bdd)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Creating volume 10cc5d4b-8146-4d24-b2b5-b803a2439578 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:02:15 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:02:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:15 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578 1073741824 Jul 09 05:02:15 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:16 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578 1073741824" returned: 0 in 0.976s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:16 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578 Jul 09 05:02:16 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:17 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578" returned: 0 in 0.911s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8f22fe-6647-4215-8694-e016f9edfd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10cc5d4b-8146-4d24-b2b5-b803a2439578', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d31f7ca-a6fa-4037-834e-19d63cc4af52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:17 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Volume volume-10cc5d4b-8146-4d24-b2b5-b803a2439578 (10cc5d4b-8146-4d24-b2b5-b803a2439578): created successfully Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d31f7ca-a6fa-4037-834e-19d63cc4af52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Flow 'volume_create_manager' (2e28c8ed-2e80-4363-ac6f-31d88efbfeca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:17 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5892f52b-affe-4cad-be9e-255a86023bc3 tempest-GroupsTest-1705712103 None] Created volume successfully. Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-04b2fd39-d67e-441a-8cda-4979eadf3f71 req-652ff2fe-299c-4ef8-85c3-e84de94172ea tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-04b2fd39-d67e-441a-8cda-4979eadf3f71 req-652ff2fe-299c-4ef8-85c3-e84de94172ea tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2a0a5d-e943-4428-90a5-5dbc8cdd4d26]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-04b2fd39-d67e-441a-8cda-4979eadf3f71 req-652ff2fe-299c-4ef8-85c3-e84de94172ea tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:18 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 Jul 09 05:02:18 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Flow 'volume_create_manager' (0ed3cc23-0bc2-441b-a5fc-d0560b9b849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e038b0e-3e4d-4ad4-b087-454ef1901a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e038b0e-3e4d-4ad4-b087-454ef1901a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1810711116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81dda129-5b95-4962-b403-c4148f8e8bb9,host='devstack@QuobyteHD#QuobyteHD',id=477f5c9d-d230-445c-bba8-9fa4e1d13d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435595b5e5214c90a684f9d840356332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:19Z,use_quota=True,user_id='bbaac1387d514ef2bffeb2158f278688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(252016cb-ac11-4023-8df2-725ce1f66bdd),volume_type_id=252016cb-ac11-4023-8df2-725ce1f66bdd)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c22e16e-d72d-4d8a-96ef-125d94c5a4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c22e16e-d72d-4d8a-96ef-125d94c5a4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1859f89-7fce-445d-b13d-83dc1fd197d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1859f89-7fce-445d-b13d-83dc1fd197d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477f5c9d-d230-445c-bba8-9fa4e1d13d3b', 'volume_name': 'volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec35502-8fe3-4f44-935f-88349493c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec35502-8fe3-4f44-935f-88349493c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d6a7b6-93fd-455a-a5f3-eca3a8ecb24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:18 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Volume 477f5c9d-d230-445c-bba8-9fa4e1d13d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b', 'volume_size': 1} Jul 09 05:02:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:19 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-04b2fd39-d67e-441a-8cda-4979eadf3f71 req-652ff2fe-299c-4ef8-85c3-e84de94172ea tempest-AttachVolumeNegativeTest-58469403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210" returned: 0 in 1.225s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-04b2fd39-d67e-441a-8cda-4979eadf3f71 req-652ff2fe-299c-4ef8-85c3-e84de94172ea tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.254s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=81dda129-5b95-4962-b403-c4148f8e8bb9,created_at=2026-07-09T03:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1810711116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81dda129-5b95-4962-b403-c4148f8e8bb9,host='devstack@QuobyteHD#QuobyteHD',id=477f5c9d-d230-445c-bba8-9fa4e1d13d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435595b5e5214c90a684f9d840356332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:19Z,use_quota=True,user_id='bbaac1387d514ef2bffeb2158f278688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(252016cb-ac11-4023-8df2-725ce1f66bdd),volume_type_id=252016cb-ac11-4023-8df2-725ce1f66bdd)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Creating volume 477f5c9d-d230-445c-bba8-9fa4e1d13d3b {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:02:19 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:19 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b 1073741824 Jul 09 05:02:19 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-04b2fd39-d67e-441a-8cda-4979eadf3f71 req-652ff2fe-299c-4ef8-85c3-e84de94172ea tempest-AttachVolumeNegativeTest-58469403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-a31c3b1c-afa5-4cfe-9b71-d36158110210', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ddd699f-b3ca-4f9b-9e7c-389742ffa5d7', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:02:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-04b2fd39-d67e-441a-8cda-4979eadf3f71 req-652ff2fe-299c-4ef8-85c3-e84de94172ea tempest-AttachVolumeNegativeTest-58469403 None] attachment_update completed successfully. Jul 09 05:02:20 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b 1073741824" returned: 0 in 0.979s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:20 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b Jul 09 05:02:20 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:20 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b" returned: 0 in 0.804s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:02:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d6a7b6-93fd-455a-a5f3-eca3a8ecb24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01baa34d-340b-45fb-be20-b56ae036bb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:21 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Volume volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b (477f5c9d-d230-445c-bba8-9fa4e1d13d3b): created successfully Jul 09 05:02:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01baa34d-340b-45fb-be20-b56ae036bb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Flow 'volume_create_manager' (0ed3cc23-0bc2-441b-a5fc-d0560b9b849e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6bca32e2-6d51-4e53-ad1e-c5aedabf217a tempest-GroupsTest-1705712103 None] Created volume successfully. Jul 09 05:02:22 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b7d2cf67-2bbd-4648-a219-70fd805b6a4f tempest-GroupsTest-1705712103 None] Update group completed successfully. Jul 09 05:02:24 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f2edb4d8-2af2-4078-b00d-a3e6f94da7f5 tempest-GroupsTest-1705712103 None] Update group completed successfully. Jul 09 05:02:25 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3d0622ca-80af-4fcc-b473-4e696501be1b tempest-GroupSnapshotsTest-1411288932 None] Group tempest-GroupSnapshotsTest-Group-155051: creating Jul 09 05:02:25 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3d0622ca-80af-4fcc-b473-4e696501be1b tempest-GroupSnapshotsTest-1411288932 None] Group tempest-GroupSnapshotsTest-Group-155051: created successfully Jul 09 05:02:25 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3d0622ca-80af-4fcc-b473-4e696501be1b tempest-GroupSnapshotsTest-1411288932 None] Create group completed successfully. Jul 09 05:02:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Acquiring lock "cinder-quobyte-10cc5d4b-8146-4d24-b2b5-b803a2439578" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Lock "cinder-quobyte-10cc5d4b-8146-4d24-b2b5-b803a2439578" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:26 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7386a7-ea20-41bb-8f65-fb3f49668f44]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:26 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578 Jul 09 05:02:26 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:26 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-c36be4fe-7735-44da-89b6-199d0098880f req-d08f9f1f-b34f-40de-98c6-e3ba75f34562 tempest-AttachVolumeNegativeTest-58469403 None] Terminate volume connection completed successfully. Jul 09 05:02:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-c36be4fe-7735-44da-89b6-199d0098880f req-d08f9f1f-b34f-40de-98c6-e3ba75f34562 tempest-AttachVolumeNegativeTest-58469403 None] Deleting attachment 0ddd699f-b3ca-4f9b-9e7c-389742ffa5d7. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:02:27 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578" returned: 0 in 1.041s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:27 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578 Jul 09 05:02:27 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Flow 'volume_create_manager' (d88d9fa6-26a9-41ea-b9b0-b4c2c7eccb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e49f899-ec37-44b3-add7-08d0b472949f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e49f899-ec37-44b3-add7-08d0b472949f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1949823353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c66227c4-72df-4f8c-9162-f544d1a2d422,host='devstack@QuobyteHD#QuobyteHD',id=3c2803f2-68d1-40ea-9e08-c8162ef6f6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfe3b4fbe9b4b35bb2094ed5dfd128c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:28Z,use_quota=True,user_id='b08a7a264cfa459c8a65787d41927f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f391674d-04ef-46bb-b5ca-b51df2d0b926),volume_type_id=f391674d-04ef-46bb-b5ca-b51df2d0b926)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6baf84-96ef-4b11-86ad-211a3997212d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6baf84-96ef-4b11-86ad-211a3997212d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bbef02-1393-4355-8fc1-b5b937dc9dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bbef02-1393-4355-8fc1-b5b937dc9dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c2803f2-68d1-40ea-9e08-c8162ef6f6a8', 'volume_name': 'volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6baa54f-07f5-4624-ba73-cd7bd711ad34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6baa54f-07f5-4624-ba73-cd7bd711ad34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a76fc5-d426-4802-831d-2181375272b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:27 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Volume 3c2803f2-68d1-40ea-9e08-c8162ef6f6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8', 'volume_size': 1} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c66227c4-72df-4f8c-9162-f544d1a2d422,created_at=2026-07-09T03:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1949823353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c66227c4-72df-4f8c-9162-f544d1a2d422,host='devstack@QuobyteHD#QuobyteHD',id=3c2803f2-68d1-40ea-9e08-c8162ef6f6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfe3b4fbe9b4b35bb2094ed5dfd128c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:28Z,use_quota=True,user_id='b08a7a264cfa459c8a65787d41927f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f391674d-04ef-46bb-b5ca-b51df2d0b926),volume_type_id=f391674d-04ef-46bb-b5ca-b51df2d0b926)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Creating volume 3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:02:27 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:02:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:27 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 1073741824 Jul 09 05:02:27 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:28 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10cc5d4b-8146-4d24-b2b5-b803a2439578" returned: 0 in 1.036s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Lock "cinder-quobyte-10cc5d4b-8146-4d24-b2b5-b803a2439578" released by "delete_volume" :: held 2.150s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Acquiring lock "cinder-quobyte-477f5c9d-d230-445c-bba8-9fa4e1d13d3b" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Lock "cinder-quobyte-477f5c9d-d230-445c-bba8-9fa4e1d13d3b" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:28 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa3b3d3-b2a9-4e99-b9d2-051be7fd7d51]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:28 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b Jul 09 05:02:28 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:29 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 1073741824" returned: 0 in 1.212s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:29 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 Jul 09 05:02:29 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:29 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b" returned: 0 in 1.068s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:29 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b Jul 09 05:02:29 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:29 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" returned: 0 in 0.739s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a76fc5-d426-4802-831d-2181375272b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c597b5f3-9b44-4ce5-b392-1716a9eb0ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:29 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Volume volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 (3c2803f2-68d1-40ea-9e08-c8162ef6f6a8): created successfully Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c597b5f3-9b44-4ce5-b392-1716a9eb0ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Flow 'volume_create_manager' (d88d9fa6-26a9-41ea-b9b0-b4c2c7eccb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e296ffaf-ed9f-4fad-98e9-f5d69497d61d tempest-GroupSnapshotsTest-1411288932 None] Created volume successfully. Jul 09 05:02:30 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-477f5c9d-d230-445c-bba8-9fa4e1d13d3b" returned: 0 in 0.775s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Lock "cinder-quobyte-477f5c9d-d230-445c-bba8-9fa4e1d13d3b" released by "delete_volume" :: held 1.908s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:30 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Created reservations ['59d144bc-af2c-432b-b648-e783348ae4e4'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:30 devstack cinder-volume[87161]: WARNING cinder.quota [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-159185189 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-159185189, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:02:30 devstack cinder-volume[87161]: WARNING cinder.quota [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-159185189 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-159185189, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:02:30 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Created reservations ['723d6677-56bf-4c58-9bc2-8080f7dd829b', 'edc96659-3126-4e22-b24f-c8f46f6ee391', '122781ff-9112-4401-a653-1a5da73dd461', 'bba59963-e853-42f6-b069-517a025cba0e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:30 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Created reservations ['488a0766-3fb1-4363-bff0-e7524e59b736', '9b8e1af4-9932-4e1a-b505-6d9491be71c3', '16d87983-5fa5-407b-b98a-863145108535', 'f671c230-c3eb-4c23-b8d9-5487121cb3f3'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Acquiring lock "cinder-b897657e-ba44-4ad3-a3af-07cfea406f7b-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Lock "cinder-b897657e-ba44-4ad3-a3af-07cfea406f7b-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] GroupSnapshot aef0bc4e-284e-4290-a7fc-6ce91053354c: creating. Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Acquiring lock "cinder-quobyte-b897657e-ba44-4ad3-a3af-07cfea406f7b" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:31 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:31 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Group snapshot aef0bc4e-284e-4290-a7fc-6ce91053354c: creating. {{(pid=87161) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Lock "cinder-quobyte-b897657e-ba44-4ad3-a3af-07cfea406f7b" acquired by "delete_volume" :: waited 0.093s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacdfa70-2cae-4e72-b213-dcc1205b53ab]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Creating offline snapshot 7454779e-63bf-4788-aac8-384f0fe152a7 of volume 3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e2dc0e-0a15-4024-80cc-e139ac168787]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:32 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b Jul 09 05:02:32 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:32 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 Jul 09 05:02:32 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:32 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.386s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:32 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:32 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-00186e56-ec32-453a-a0fc-6efa2798c6f8 tempest-GroupsTest-1705712103 None] Delete group completed successfully. Jul 09 05:02:33 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" returned: 0 in 1.658s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:33 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 1G Jul 09 05:02:33 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:33 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b" returned: 0 in 2.049s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:33 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b Jul 09 05:02:33 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:34 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 1G" returned: 0 in 0.953s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:34 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 Jul 09 05:02:34 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:34 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b897657e-ba44-4ad3-a3af-07cfea406f7b" returned: 0 in 0.770s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Lock "cinder-quobyte-b897657e-ba44-4ad3-a3af-07cfea406f7b" released by "delete_volume" :: held 2.908s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Created reservations ['ce5a092c-973b-4c05-a9dd-e17509258dc0', '6d35ea42-f0c0-48c1-8c51-f8ccb34e35fd', '132362e0-f898-4551-a536-49aa9099a240', 'c6839eee-02bd-4018-b155-60943b7db67c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:34 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:34 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:35 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7" returned: 0 in 1.184s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:35 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:02:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:35 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 Jul 09 05:02:35 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:36 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.478s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:36 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:36 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Deleted volume successfully. Jul 09 05:02:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09cbb4e0-7eb0-4e0c-8fa3-eec17f1e4081 tempest-ServerRescueNegativeTestJSON-286126704 None] Lock "cinder-b897657e-ba44-4ad3-a3af-07cfea406f7b-delete_volume" released by "delete_volume" :: held 5.086s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:36 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7" returned: 0 in 1.035s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:36 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.info Jul 09 05:02:36 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:37 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.info" returned: 0 in 1.095s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:37 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:02:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:37 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.info Jul 09 05:02:37 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:39 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.info" returned: 0 in 1.505s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:39 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:39 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.693s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:39 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4725427c-08f2-41a2-a10c-5c4cf910bd2a tempest-GroupSnapshotsTest-1411288932 None] group_snapshot aef0bc4e-284e-4290-a7fc-6ce91053354c: created successfully Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "cinder-a31c3b1c-afa5-4cfe-9b71-d36158110210-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-a31c3b1c-afa5-4cfe-9b71-d36158110210-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "cinder-quobyte-a31c3b1c-afa5-4cfe-9b71-d36158110210" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-quobyte-a31c3b1c-afa5-4cfe-9b71-d36158110210" acquired by "delete_volume" :: waited 0.051s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3c38a9-7465-4268-bd02-813a1b6ae94e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:39 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 Jul 09 05:02:39 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:40 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.949s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:40 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:40 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:02:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 8 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:02:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:02:40 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210" returned: 0 in 1.097s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:40 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210 Jul 09 05:02:40 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Flow 'volume_create_manager' (472d7149-a0f7-47d3-8508-0df9d4357a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b4580a-23dc-4178-b302-6c0cf192c49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b4580a-23dc-4178-b302-6c0cf192c49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-65204350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07aef2ca-baa4-4a37-8169-3181756eef48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ffc6e18c984e398598d9cad231dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:41Z,use_quota=True,user_id='c12353007b764751b77a74feea2da382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9917bc51-7e67-4259-a271-aeee6632668a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9917bc51-7e67-4259-a271-aeee6632668a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4de651-38e4-460d-92bb-8809eb86ad2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4de651-38e4-460d-92bb-8809eb86ad2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07aef2ca-baa4-4a37-8169-3181756eef48', 'volume_name': 'volume-07aef2ca-baa4-4a37-8169-3181756eef48', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca66b2d-5c89-4e98-9c0d-78b9c6f61f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca66b2d-5c89-4e98-9c0d-78b9c6f61f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d72ba9f-bd58-496c-848e-87e2c5ebe3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:41 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Volume 07aef2ca-baa4-4a37-8169-3181756eef48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07aef2ca-baa4-4a37-8169-3181756eef48', 'volume_size': 1} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-65204350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07aef2ca-baa4-4a37-8169-3181756eef48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ffc6e18c984e398598d9cad231dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:02:41Z,use_quota=True,user_id='c12353007b764751b77a74feea2da382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Creating volume 07aef2ca-baa4-4a37-8169-3181756eef48 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:02:41 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:41 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48 1073741824 Jul 09 05:02:41 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:41 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a31c3b1c-afa5-4cfe-9b71-d36158110210" returned: 0 in 1.093s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-quobyte-a31c3b1c-afa5-4cfe-9b71-d36158110210" released by "delete_volume" :: held 2.258s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Created reservations ['c11e0638-95e3-458f-9331-147caabf79fe', '18eb6be4-5db8-4746-b3c6-4453b8d87687', '3fe7f43b-d7c7-48c8-b9ee-3ad77270e7bd', '44d65f40-ef67-4596-b229-d61bc3272ea2'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:42 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:42 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "cinder-662172d8-c18c-4fe1-92d7-73248dddd057-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-662172d8-c18c-4fe1-92d7-73248dddd057-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "cinder-quobyte-662172d8-c18c-4fe1-92d7-73248dddd057" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-quobyte-662172d8-c18c-4fe1-92d7-73248dddd057" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f00d49-5ef6-4f95-994c-eb46f7c7f267]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:42 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48 1073741824" returned: 0 in 1.119s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:42 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48 Jul 09 05:02:42 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:42 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 Jul 09 05:02:42 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:42 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.748s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:42 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:42 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Deleted volume successfully. Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-37712c2c-df4f-48bf-b9c7-a9926116965d tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-a31c3b1c-afa5-4cfe-9b71-d36158110210-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:43 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057" returned: 0 in 0.802s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:43 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057 Jul 09 05:02:43 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:43 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48" returned: 0 in 0.785s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.806s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-7454779e-63bf-4788-aac8-384f0fe152a7-8190cd47-6632-4146-80ad-fedf3a0af1ff" by "_create_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d72ba9f-bd58-496c-848e-87e2c5ebe3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07aef2ca-baa4-4a37-8169-3181756eef48', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59639b0a-302f-4953-8317-bf6eb58db7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-7454779e-63bf-4788-aac8-384f0fe152a7-8190cd47-6632-4146-80ad-fedf3a0af1ff" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Creating volume 8190cd47-6632-4146-80ad-fedf3a0af1ff from snapshot 7454779e-63bf-4788-aac8-384f0fe152a7 {{(pid=87161) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-8190cd47-6632-4146-80ad-fedf3a0af1ff" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:43 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Volume volume-07aef2ca-baa4-4a37-8169-3181756eef48 (07aef2ca-baa4-4a37-8169-3181756eef48): created successfully Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59639b0a-302f-4953-8317-bf6eb58db7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Flow 'volume_create_manager' (472d7149-a0f7-47d3-8508-0df9d4357a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-8190cd47-6632-4146-80ad-fedf3a0af1ff" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] snapshot: 7454779e-63bf-4788-aac8-384f0fe152a7, volume: 8190cd47-6632-4146-80ad-fedf3a0af1ff, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:02:43 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b759fb05-6e07-40e5-a6d4-8b8820ecb3d3 tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Created volume successfully. Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e653bb-b439-4b2f-95f8-176ddb916f94]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:43 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 Jul 09 05:02:43 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:44 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-662172d8-c18c-4fe1-92d7-73248dddd057" returned: 0 in 0.677s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-quobyte-662172d8-c18c-4fe1-92d7-73248dddd057" released by "delete_volume" :: held 1.520s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Created reservations ['f4619ad1-9f54-47e5-a5c0-c528f19292ca', '08d466b1-8a56-44ff-bc5c-7187d38a8819', 'bd9c12f2-d23e-426a-a814-c4ad619f146c', '2239fbdd-3fcd-4149-85cd-20a8228b42df'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:44 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:44 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:44 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7" returned: 0 in 0.801s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91ef28f-2841-4374-a331-3868c3205d36]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:44 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 Jul 09 05:02:44 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:45 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.720s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:45 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Deleted volume successfully. Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "cinder-dbde3f7c-588b-4333-9498-baaaa1530fd0-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-dbde3f7c-588b-4333-9498-baaaa1530fd0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aedaa91e-c854-4dc3-9d13-d613b1b2898c tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-662172d8-c18c-4fe1-92d7-73248dddd057-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "cinder-quobyte-dbde3f7c-588b-4333-9498-baaaa1530fd0" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-quobyte-dbde3f7c-588b-4333-9498-baaaa1530fd0" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a139e0-e68d-47b3-97a5-96878e9bbfc6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:45 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 Jul 09 05:02:45 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:45 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" returned: 0 in 0.930s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:45 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff Jul 09 05:02:45 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Acquiring lock "cinder-07aef2ca-baa4-4a37-8169-3181756eef48-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Lock "cinder-07aef2ca-baa4-4a37-8169-3181756eef48-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Acquiring lock "cinder-quobyte-07aef2ca-baa4-4a37-8169-3181756eef48" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Lock "cinder-quobyte-07aef2ca-baa4-4a37-8169-3181756eef48" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aae867e-94f7-4f5a-b7f0-6fae340bc07d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:46 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48 Jul 09 05:02:46 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:46 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0" returned: 0 in 0.907s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:46 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0 Jul 09 05:02:46 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:47 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dbde3f7c-588b-4333-9498-baaaa1530fd0" returned: 0 in 1.204s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-quobyte-dbde3f7c-588b-4333-9498-baaaa1530fd0" released by "delete_volume" :: held 2.172s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Created reservations ['a32c616f-b1a4-47e8-a4b3-bc007ef75a2d', '1172db34-2515-48b1-a775-26fd9bf4a4a6', '51bea83f-5c7d-47b8-a75a-e0e71a14fe8a', 'cb123131-70c4-4981-b585-9ba407997724'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:47 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48" returned: 0 in 1.859s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:47 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48 Jul 09 05:02:47 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:48 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:48 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:49 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:49 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-07aef2ca-baa4-4a37-8169-3181756eef48" returned: 0 in 1.976s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.872s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:49 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Lock "cinder-quobyte-07aef2ca-baa4-4a37-8169-3181756eef48" released by "delete_volume" :: held 3.957s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:49 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Deleted volume successfully. Jul 09 05:02:49 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=93,cinder:UPDATE=94,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:02:49 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=94,cinder:UPDATE=112,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:02:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8bb5c8fb-c2d3-405a-b953-4793d31bdd53 tempest-AttachVolumeNegativeTest-58469403 None] Lock "cinder-dbde3f7c-588b-4333-9498-baaaa1530fd0-delete_volume" released by "delete_volume" :: held 4.770s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:50 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Created reservations ['c25c8cf4-0ebc-40f4-ad92-4f1529e97643', 'd2dd92e1-ab42-4b9c-9c9e-4d5171259810', 'f68711ac-60a3-4c09-b967-a9cbff301c6e', 'dc203b83-0b3e-4b62-9cf1-8ed0ef0422f1'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:50 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:50 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:51 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.617s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:51 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Deleted volume successfully. Jul 09 05:02:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cd43b01-2703-42c8-9573-c186d0e9d2fa tempest-VolumeQuotasNegativeTestJSON-1793921373 None] Lock "cinder-07aef2ca-baa4-4a37-8169-3181756eef48-delete_volume" released by "delete_volume" :: held 6.188s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:52 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff" returned: 0 in 7.015s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:52 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b259952-ace5-4da4-a991-0e9c5ff18a90]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:52 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 Jul 09 05:02:52 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:53 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" returned: 0 in 1.076s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:53 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:02:53 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Converted 1024.00 MB image at 145.91 MB/s Jul 09 05:02:53 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:02:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:53 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff Jul 09 05:02:53 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:54 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff" returned: 0 in 0.817s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-8190cd47-6632-4146-80ad-fedf3a0af1ff" released by "_copy_volume_from_snapshot" :: held 10.760s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-7454779e-63bf-4788-aac8-384f0fe152a7-8190cd47-6632-4146-80ad-fedf3a0af1ff" released by "_create_volume_from_snapshot" :: held 10.816s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.850s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-30bc08d1-0a50-4268-b09d-4818c68c5361 tempest-GroupSnapshotsTest-1411288932 None] Create group from source-snapshot-aef0bc4e-284e-4290-a7fc-6ce91053354c completed successfully. Jul 09 05:02:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-8190cd47-6632-4146-80ad-fedf3a0af1ff" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-8190cd47-6632-4146-80ad-fedf3a0af1ff" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:55 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcaa82b-20ef-4ec3-a633-a1d817892dc6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:56 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff Jul 09 05:02:56 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:56 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff" returned: 0 in 0.967s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:56 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff Jul 09 05:02:56 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:57 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8190cd47-6632-4146-80ad-fedf3a0af1ff" returned: 0 in 0.865s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-8190cd47-6632-4146-80ad-fedf3a0af1ff" released by "delete_volume" :: held 1.910s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:02:57 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['b235eaa7-1109-457f-8834-c40217e9f038'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:57 devstack cinder-volume[87161]: WARNING cinder.quota [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1756949660 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1756949660, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:02:57 devstack cinder-volume[87161]: WARNING cinder.quota [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1756949660 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1756949660, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:02:57 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['c6c436cc-b04d-4140-9073-99f504c18ba2', '31767ece-27db-4030-9c63-862e73380b32', '0f0dfc7c-ba57-4f86-9102-64801ef12140', 'dd1500b1-6cb3-45fd-af57-3beca20f11a9'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:58 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:02:58 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] group_snapshot aef0bc4e-284e-4290-a7fc-6ce91053354c: deleting Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] group_snapshot aef0bc4e-284e-4290-a7fc-6ce91053354c: deleting {{(pid=87161) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-7454779e-63bf-4788-aac8-384f0fe152a7" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-7454779e-63bf-4788-aac8-384f0fe152a7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Deleting offline snapshot 7454779e-63bf-4788-aac8-384f0fe152a7 of volume 3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] snapshot_file for this snap is: volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e336be0-820c-404c-bd95-adf6b856c858]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:58 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 Jul 09 05:02:58 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:02:58 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.802s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:58 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:02:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b5ed3d66-75d8-40ff-840d-2ada35e2ecc8 tempest-GroupSnapshotsTest-1411288932 None] Delete group completed successfully. Jul 09 05:02:59 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Jul 09 05:02:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7" returned: 0 in 0.974s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:02:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:02:59 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a752bf-d718-40b7-8081-033db990b9af]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:02:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:02:59 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 Jul 09 05:02:59 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Flow 'volume_create_manager' (6d539598-a129-4d1b-9260-3f4f3f4b91b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1b0019-f02f-4f45-8f21-8b29a875c626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1b0019-f02f-4f45-8f21-8b29a875c626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1241311845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a8faab-9ec4-4313-8a00-2f4f574b54b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a6a1e29b66465e979d97c078bd1fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:00Z,use_quota=True,user_id='509691e7479f4cb3aa8981a94e9c8ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bcf572-b33c-482c-921f-d1643e45c503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bcf572-b33c-482c-921f-d1643e45c503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2846de5d-5237-4797-9aa2-c59d8e991153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2846de5d-5237-4797-9aa2-c59d8e991153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a8faab-9ec4-4313-8a00-2f4f574b54b8', 'volume_name': 'volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2996a05-0566-4383-91b1-cbcfea6b9e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2996a05-0566-4383-91b1-cbcfea6b9e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfd2602-8399-4ce8-9fe1-b8d35234db25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:00 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Volume f1a8faab-9ec4-4313-8a00-2f4f574b54b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8', 'volume_size': 1} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1241311845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a8faab-9ec4-4313-8a00-2f4f574b54b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a6a1e29b66465e979d97c078bd1fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:00Z,use_quota=True,user_id='509691e7479f4cb3aa8981a94e9c8ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Creating volume f1a8faab-9ec4-4313-8a00-2f4f574b54b8 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:03:00 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:00 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8 1073741824 Jul 09 05:03:00 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:00 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" returned: 0 in 0.957s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:00 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 Jul 09 05:03:00 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:01 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8 1073741824" returned: 0 in 1.061s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Flow 'volume_create_manager' (56f168fc-ce9d-405a-a260-14c0943385eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:01 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8 Jul 09 05:03:01 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e2227d-c173-41a7-98cf-312c378f3f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e2227d-c173-41a7-98cf-312c378f3f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-837228936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c990a3af-d707-4fad-9cdd-1fca57111b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd1f663e3484865b0a5138958054d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:01Z,use_quota=True,user_id='9205980d6f8f46b6ab113576572e4a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34c7d54-67c6-4194-a607-0a63c2a16650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34c7d54-67c6-4194-a607-0a63c2a16650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f654e474-ebd7-4ab9-831e-2ea0aeb71274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f654e474-ebd7-4ab9-831e-2ea0aeb71274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c990a3af-d707-4fad-9cdd-1fca57111b66', 'volume_name': 'volume-c990a3af-d707-4fad-9cdd-1fca57111b66', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0df4abf-a042-4b67-ad89-2fbcfb8a0b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0df4abf-a042-4b67-ad89-2fbcfb8a0b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d63e76-3440-49af-93d7-309fa7941f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:01 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Volume c990a3af-d707-4fad-9cdd-1fca57111b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c990a3af-d707-4fad-9cdd-1fca57111b66', 'volume_size': 1} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:01 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7" returned: 0 in 0.945s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:01 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7 Jul 09 05:03:01 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:01 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8" returned: 0 in 0.724s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-837228936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c990a3af-d707-4fad-9cdd-1fca57111b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd1f663e3484865b0a5138958054d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:01Z,use_quota=True,user_id='9205980d6f8f46b6ab113576572e4a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Creating volume c990a3af-d707-4fad-9cdd-1fca57111b66 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:03:02 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfd2602-8399-4ce8-9fe1-b8d35234db25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee561e6-5592-4bbb-8e7f-5e2a302a9c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:02 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 1073741824 Jul 09 05:03:02 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:02 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Volume volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8 (f1a8faab-9ec4-4313-8a00-2f4f574b54b8): created successfully Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee561e6-5592-4bbb-8e7f-5e2a302a9c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Flow 'volume_create_manager' (6d539598-a129-4d1b-9260-3f4f3f4b91b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:02 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f87b1f84-4595-46dd-8340-ab32045c7ec2 tempest-VolumesServicesTestJSON-1491745876 None] Created volume successfully. Jul 09 05:03:02 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8.7454779e-63bf-4788-aac8-384f0fe152a7" returned: 0 in 0.757s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-7454779e-63bf-4788-aac8-384f0fe152a7" released by "_delete_snapshot" :: held 3.769s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" released by "delete_snapshot" :: held 3.802s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:02 devstack cinder-volume[87161]: WARNING cinder.quota [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1756949660 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1756949660, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['963241e5-8f80-41a3-8d85-64f79be6fef8', 'c5a492f3-07fd-4300-9535-47f73ea3e5bf', 'c0f72a3a-7beb-4b5e-a43f-24774726bdf2', '1b809050-88be-4bbb-9c24-d5937222db45'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:02 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-db05bc0a-ce59-403a-85b3-e28ef2229891 tempest-GroupSnapshotsTest-1411288932 None] group_snapshot aef0bc4e-284e-4290-a7fc-6ce91053354c: deleted successfully Jul 09 05:03:02 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 1073741824" returned: 0 in 0.950s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:03 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 Jul 09 05:03:03 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" acquired by "delete_volume" :: waited 0.031s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8920be70-26a7-43ad-9807-1bd6890240aa]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Acquiring lock "cinder-f1a8faab-9ec4-4313-8a00-2f4f574b54b8-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Lock "cinder-f1a8faab-9ec4-4313-8a00-2f4f574b54b8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Acquiring lock "cinder-quobyte-f1a8faab-9ec4-4313-8a00-2f4f574b54b8" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Lock "cinder-quobyte-f1a8faab-9ec4-4313-8a00-2f4f574b54b8" acquired by "delete_volume" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:03 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 Jul 09 05:03:03 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1742ff9-2940-42ee-8780-e5f0378c2d24]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:03 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8 Jul 09 05:03:03 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:03 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66" returned: 0 in 0.904s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d63e76-3440-49af-93d7-309fa7941f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c990a3af-d707-4fad-9cdd-1fca57111b66', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594c9842-576d-44fd-8c0e-b3d5925ce186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:03 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Volume volume-c990a3af-d707-4fad-9cdd-1fca57111b66 (c990a3af-d707-4fad-9cdd-1fca57111b66): created successfully Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594c9842-576d-44fd-8c0e-b3d5925ce186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Flow 'volume_create_manager' (56f168fc-ce9d-405a-a260-14c0943385eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-87a20423-c5de-403a-bcfe-576c15790657 req-111f9fc6-efc9-4489-b2f2-70530afee1e0 tempest-VolumesSnapshotsTestJSON-431611021 None] Created volume successfully. Jul 09 05:03:04 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" returned: 0 in 0.876s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:04 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8 Jul 09 05:03:04 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:04 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8" returned: 0 in 0.837s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:04 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8 Jul 09 05:03:04 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:04 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" returned: 0 in 0.701s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Creating offline snapshot fc95c44f-2428-4743-b4d9-31956f5ab0ff of volume c990a3af-d707-4fad-9cdd-1fca57111b66 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-3c2803f2-68d1-40ea-9e08-c8162ef6f6a8" released by "delete_volume" :: held 1.721s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea41483f-738a-4d6e-a67d-98dc2302149f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['762f803a-5fc0-4495-a49a-3ed841e7ab62'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:05 devstack cinder-volume[87161]: WARNING cinder.db.api [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1756949660'] Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['53f0f6dc-412c-4d4b-b840-80de9d50e3ba', '904e14bd-abbb-4482-813c-6cf1074abbea', '7e3eadb9-2eb8-4cae-8568-5233b8105361', '49f24af1-658c-4d02-99fa-b1bc3b582c4e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:05 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 Jul 09 05:03:05 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:05 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f1a8faab-9ec4-4313-8a00-2f4f574b54b8" returned: 0 in 0.904s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:05 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:03:05 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Lock "cinder-quobyte-f1a8faab-9ec4-4313-8a00-2f4f574b54b8" released by "delete_volume" :: held 1.802s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Created reservations ['3f16cc37-a16f-478a-bd82-0ed7a53d8983', 'cf4f7ae1-d227-4336-b155-98c2edf2a8d6', 'c90d5dd4-6007-440d-a90a-777f5493309c', 'b05f00cc-982c-43c7-a69a-303cd801ee08'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:05 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:03:05 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:06 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66" returned: 0 in 1.309s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:06 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff 1G Jul 09 05:03:06 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:06 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.096s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:06 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:03:06 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ca51b45b-89b3-47ef-b4f8-9d07d764b6a1 tempest-GroupSnapshotsTest-1411288932 None] Delete group completed successfully. Jul 09 05:03:06 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c1a65242-9f1a-418d-9778-f0afef464ba3 tempest-GroupSnapshotsTest-1411288932 None] Group tempest-GroupSnapshotsTest-Group-1947149431: creating Jul 09 05:03:06 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.979s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:06 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:03:06 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Deleted volume successfully. Jul 09 05:03:06 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c1a65242-9f1a-418d-9778-f0afef464ba3 tempest-GroupSnapshotsTest-1411288932 None] Group tempest-GroupSnapshotsTest-Group-1947149431: created successfully Jul 09 05:03:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b96d58a9-f27e-4d48-aec6-48cfe5213b4e tempest-VolumesServicesTestJSON-1491745876 None] Lock "cinder-f1a8faab-9ec4-4313-8a00-2f4f574b54b8-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:06 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c1a65242-9f1a-418d-9778-f0afef464ba3 tempest-GroupSnapshotsTest-1411288932 None] Create group completed successfully. Jul 09 05:03:07 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff 1G" returned: 0 in 1.055s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c990a3af-d707-4fad-9cdd-1fca57111b66 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:07 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c990a3af-d707-4fad-9cdd-1fca57111b66 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff Jul 09 05:03:07 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:08 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c990a3af-d707-4fad-9cdd-1fca57111b66 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff" returned: 0 in 0.949s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:08 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff is being set with open permissions: ugo+rw Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:03:08 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff Jul 09 05:03:08 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Flow 'volume_create_manager' (483421bb-0ea8-45c0-b194-250ef82094cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0787e01e-2811-4424-b9a3-939dc373cf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0787e01e-2811-4424-b9a3-939dc373cf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-852295007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fac070de-a4aa-42bb-9223-5c72ce26d222,host='devstack@QuobyteHD#QuobyteHD',id=bf20a2c2-09fa-45f6-b588-3fb963ec0b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfe3b4fbe9b4b35bb2094ed5dfd128c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:08Z,use_quota=True,user_id='b08a7a264cfa459c8a65787d41927f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(787a1cb0-799f-44ab-8e52-965d852888af),volume_type_id=787a1cb0-799f-44ab-8e52-965d852888af)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdd1193-f663-40a9-a529-f6eb75f11372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdd1193-f663-40a9-a529-f6eb75f11372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eeb514f-52b3-4060-9e17-56b2e4230146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eeb514f-52b3-4060-9e17-56b2e4230146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf20a2c2-09fa-45f6-b588-3fb963ec0b21', 'volume_name': 'volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ab30f8-2e25-44c9-bb4f-8f6711bfe7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ab30f8-2e25-44c9-bb4f-8f6711bfe7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a5ac63-5ca2-48aa-8dc7-31d82b0f0037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:08 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Volume bf20a2c2-09fa-45f6-b588-3fb963ec0b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21', 'volume_size': 1} Jul 09 05:03:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:09 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff" returned: 0 in 0.778s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:09 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.info Jul 09 05:03:09 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:09 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.info" returned: 0 in 0.742s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:09 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.info is being set with open permissions: ugo+rw Jul 09 05:03:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:09 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.info Jul 09 05:03:09 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:10 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.info" returned: 0 in 0.728s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.740s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.184s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fac070de-a4aa-42bb-9223-5c72ce26d222,created_at=2026-07-09T03:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-852295007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fac070de-a4aa-42bb-9223-5c72ce26d222,host='devstack@QuobyteHD#QuobyteHD',id=bf20a2c2-09fa-45f6-b588-3fb963ec0b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfe3b4fbe9b4b35bb2094ed5dfd128c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:08Z,use_quota=True,user_id='b08a7a264cfa459c8a65787d41927f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(787a1cb0-799f-44ab-8e52-965d852888af),volume_type_id=787a1cb0-799f-44ab-8e52-965d852888af)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Creating volume bf20a2c2-09fa-45f6-b588-3fb963ec0b21 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:03:10 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:10 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 1073741824 Jul 09 05:03:10 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:10 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-81b33a6e-63bc-4707-8ef5-ceb1f1f28603 req-31777e20-05f7-48b8-8e65-11c510b98925 tempest-VolumesSnapshotsTestJSON-431611021 None] Create snapshot completed successfully Jul 09 05:03:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Acquiring lock "cinder-fc95c44f-2428-4743-b4d9-31956f5ab0ff-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "cinder-fc95c44f-2428-4743-b4d9-31956f5ab0ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Acquiring lock "cinder-quobyte-c990a3af-d707-4fad-9cdd-1fca57111b66" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "cinder-quobyte-c990a3af-d707-4fad-9cdd-1fca57111b66" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Acquiring lock "cinder-quobyte-fc95c44f-2428-4743-b4d9-31956f5ab0ff" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "cinder-quobyte-fc95c44f-2428-4743-b4d9-31956f5ab0ff" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Deleting offline snapshot fc95c44f-2428-4743-b4d9-31956f5ab0ff of volume c990a3af-d707-4fad-9cdd-1fca57111b66 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] snapshot_file for this snap is: volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[191820d2-6f26-4db1-9ff8-897d3cb08b2a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:11 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff Jul 09 05:03:11 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:11 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 1073741824" returned: 0 in 1.187s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:11 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 Jul 09 05:03:12 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:12 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff" returned: 0 in 0.954s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c990a3af-d707-4fad-9cdd-1fca57111b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ea1b84-e47f-4f13-b460-ba013f2443be]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:12 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 Jul 09 05:03:12 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:12 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" returned: 0 in 0.849s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a5ac63-5ca2-48aa-8dc7-31d82b0f0037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813e1923-44f5-4eb4-9669-d532691cd44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:12 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Volume volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 (bf20a2c2-09fa-45f6-b588-3fb963ec0b21): created successfully Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813e1923-44f5-4eb4-9669-d532691cd44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Flow 'volume_create_manager' (483421bb-0ea8-45c0-b194-250ef82094cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:12 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6e9369a0-bddb-4bd5-95b1-d0f89aee5c47 tempest-GroupSnapshotsTest-1411288932 None] Created volume successfully. Jul 09 05:03:13 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66" returned: 0 in 1.020s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:13 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff Jul 09 05:03:13 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:13 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Flow 'volume_create_manager' (d454ef27-dae5-404f-bb33-42ceb8fea07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8775a5ba-6cd8-4885-9f5e-6fe1c12ff592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8775a5ba-6cd8-4885-9f5e-6fe1c12ff592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-994344681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fac070de-a4aa-42bb-9223-5c72ce26d222,host='devstack@QuobyteHD#QuobyteHD',id=e30879aa-8871-495e-b065-acb87eef413c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfe3b4fbe9b4b35bb2094ed5dfd128c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:14Z,use_quota=True,user_id='b08a7a264cfa459c8a65787d41927f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(787a1cb0-799f-44ab-8e52-965d852888af),volume_type_id=787a1cb0-799f-44ab-8e52-965d852888af)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98df4062-59f6-4a9c-9baf-4b7dd1c286e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98df4062-59f6-4a9c-9baf-4b7dd1c286e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c94d57-d9bc-469e-808a-2ca743eca647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c94d57-d9bc-469e-808a-2ca743eca647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30879aa-8871-495e-b065-acb87eef413c', 'volume_name': 'volume-e30879aa-8871-495e-b065-acb87eef413c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafac933-46e0-4169-b778-3f728474af59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafac933-46e0-4169-b778-3f728474af59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d407e2e-43b8-44c0-ba04-821e34d74b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:14 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Volume e30879aa-8871-495e-b065-acb87eef413c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30879aa-8871-495e-b065-acb87eef413c', 'volume_size': 1} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fac070de-a4aa-42bb-9223-5c72ce26d222,created_at=2026-07-09T03:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-994344681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fac070de-a4aa-42bb-9223-5c72ce26d222,host='devstack@QuobyteHD#QuobyteHD',id=e30879aa-8871-495e-b065-acb87eef413c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfe3b4fbe9b4b35bb2094ed5dfd128c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:14Z,use_quota=True,user_id='b08a7a264cfa459c8a65787d41927f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(787a1cb0-799f-44ab-8e52-965d852888af),volume_type_id=787a1cb0-799f-44ab-8e52-965d852888af)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Creating volume e30879aa-8871-495e-b065-acb87eef413c {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:03:14 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:14 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c 1073741824 Jul 09 05:03:14 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:14 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff" returned: 0 in 1.079s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:14 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff Jul 09 05:03:14 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:15 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66.fc95c44f-2428-4743-b4d9-31956f5ab0ff" returned: 0 in 0.909s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:15 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c 1073741824" returned: 0 in 1.126s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "cinder-quobyte-fc95c44f-2428-4743-b4d9-31956f5ab0ff" released by "_delete_snapshot" :: held 4.153s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "cinder-quobyte-c990a3af-d707-4fad-9cdd-1fca57111b66" released by "delete_snapshot" :: held 4.202s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:15 devstack cinder-volume[87161]: WARNING cinder.quota [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:03:15 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c Jul 09 05:03:15 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG cinder.quota [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Created reservations ['5ef7d62f-7fa1-40ef-b10c-2d8eebf54b78', '962285b1-6af4-413b-a794-e0d941d9a53a', '773d6f24-e572-418b-a9d6-60681af81d36', '86b0df89-618e-4dd5-9165-8a80a41b62a0'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:15 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Delete snapshot completed successfully. Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-ead78dd3-fcba-42dc-86bb-5265fb2e101d req-d132fb51-039f-43ee-a055-b8e63c867428 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "cinder-fc95c44f-2428-4743-b4d9-31956f5ab0ff-delete_snapshot" released by "delete_snapshot" :: held 4.433s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Acquiring lock "cinder-c990a3af-d707-4fad-9cdd-1fca57111b66-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "cinder-c990a3af-d707-4fad-9cdd-1fca57111b66-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Acquiring lock "cinder-quobyte-c990a3af-d707-4fad-9cdd-1fca57111b66" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "cinder-quobyte-c990a3af-d707-4fad-9cdd-1fca57111b66" acquired by "delete_volume" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[853021f4-5334-4c48-98df-04a83b59f6f0]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:15 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 Jul 09 05:03:15 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:16 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c" returned: 0 in 0.881s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:03:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d407e2e-43b8-44c0-ba04-821e34d74b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30879aa-8871-495e-b065-acb87eef413c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55dc035-c14e-416f-ae3b-35341df213c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:16 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Volume volume-e30879aa-8871-495e-b065-acb87eef413c (e30879aa-8871-495e-b065-acb87eef413c): created successfully Jul 09 05:03:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55dc035-c14e-416f-ae3b-35341df213c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Flow 'volume_create_manager' (d454ef27-dae5-404f-bb33-42ceb8fea07f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ddcca111-19f5-49b8-809d-a3e66504f598 tempest-GroupSnapshotsTest-1411288932 None] Created volume successfully. Jul 09 05:03:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9074c7c5-ebe0-4b2f-b4b6-2cf40ccc0006 tempest-GroupSnapshotsTest-1411288932 None] Update group completed successfully. Jul 09 05:03:16 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66" returned: 0 in 0.969s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:16 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66 Jul 09 05:03:16 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:17 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c990a3af-d707-4fad-9cdd-1fca57111b66" returned: 0 in 0.721s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "cinder-quobyte-c990a3af-d707-4fad-9cdd-1fca57111b66" released by "delete_volume" :: held 1.781s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:17 devstack cinder-volume[87161]: DEBUG cinder.quota [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Created reservations ['d0cce792-1dbf-48bf-81ff-ca4eaeb66eca', 'ca41a8e2-58cd-41ae-a1d8-39d5dd844b5e', '48ddf774-1eca-4fa4-9109-f89e74bf119c', 'db856448-8a88-4d19-8544-4cd0be7ed81c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:17 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:03:17 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:17 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-33428ed1-325d-4307-9bc9-2dd169f66ea8 tempest-GroupSnapshotsTest-1411288932 None] Update group completed successfully. Jul 09 05:03:18 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.848s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:18 devstack cinder-volume[87161]: DEBUG cinder.manager [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:03:18 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Deleted volume successfully. Jul 09 05:03:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-26ab2e44-0811-45ff-be63-295b007c48d2 req-67ef800c-cc72-486c-858b-d78617bc75e7 tempest-VolumesSnapshotsTestJSON-431611021 None] Lock "cinder-c990a3af-d707-4fad-9cdd-1fca57111b66-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-29c79a20-70fd-48ea-9809-3f20f67f8e13 tempest-GroupSnapshotsTest-1411288932 None] Update group completed successfully. Jul 09 05:03:20 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c3ec7a81-4119-4961-b2d6-ec2a53702855 tempest-GroupSnapshotsTest-1411288932 None] Update group completed successfully. Jul 09 05:03:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] GroupSnapshot 02a169f7-f78f-4417-ad74-c55a4d512247: creating. Jul 09 05:03:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Group snapshot 02a169f7-f78f-4417-ad74-c55a4d512247: creating. {{(pid=87161) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 05:03:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Creating offline snapshot 34675a3e-d17c-4d59-accb-dce97c9454cd of volume e30879aa-8871-495e-b065-acb87eef413c {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:03:22 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2416ff-b8d9-4b87-b1df-1364caa91590]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:22 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c Jul 09 05:03:22 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:22 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c" returned: 0 in 0.949s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:23 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd 1G Jul 09 05:03:23 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-65bbd550-fb64-470f-bacd-1bd77de02730 tempest-BackendsCapabilitiesAdminTestsJSON-531576729 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87161) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 05:03:23 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd 1G" returned: 0 in 0.842s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30879aa-8871-495e-b065-acb87eef413c -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:23 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30879aa-8871-495e-b065-acb87eef413c -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd Jul 09 05:03:23 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4293b0db-27d5-4ce8-b6b4-9f19d6b14494 tempest-BackendsCapabilitiesAdminTestsJSON-531576729 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87161) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 05:03:24 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30879aa-8871-495e-b065-acb87eef413c -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd" returned: 0 in 0.727s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:24 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:03:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:24 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd Jul 09 05:03:24 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:25 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd" returned: 0 in 0.721s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:25 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.info Jul 09 05:03:25 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:26 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.info" returned: 0 in 1.064s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:26 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:03:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:26 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.info Jul 09 05:03:26 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:27 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.info" returned: 0 in 0.767s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.179s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Creating offline snapshot ef824458-5871-4c4d-9e6d-c8dabce44108 of volume bf20a2c2-09fa-45f6-b588-3fb963ec0b21 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:03:27 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e7f1ed-32a7-43d2-8c03-2fe4ee97dcdc]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:27 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 Jul 09 05:03:27 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:28 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" returned: 0 in 1.046s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:28 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 1G Jul 09 05:03:28 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:29 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 1G" returned: 0 in 0.991s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:29 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 Jul 09 05:03:29 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:30 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108" returned: 0 in 0.828s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:30 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:03:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:30 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 Jul 09 05:03:30 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:30 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108" returned: 0 in 0.680s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:30 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.info Jul 09 05:03:30 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:31 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.info" returned: 0 in 1.019s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:31 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:03:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:31 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.info Jul 09 05:03:31 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:32 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-67aef81d-6776-41ad-a155-32287fcea178 tempest-GroupsV314Test-637771251 None] Group tempest-GroupsV314Test-Group-343636538: creating Jul 09 05:03:32 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-67aef81d-6776-41ad-a155-32287fcea178 tempest-GroupsV314Test-637771251 None] Group tempest-GroupsV314Test-Group-343636538: created successfully Jul 09 05:03:32 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-67aef81d-6776-41ad-a155-32287fcea178 tempest-GroupsV314Test-637771251 None] Create group completed successfully. Jul 09 05:03:32 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.info" returned: 0 in 0.857s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.538s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:32 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d8aaff0c-399c-48dd-b913-83ccedc81041 tempest-GroupSnapshotsTest-1411288932 None] group_snapshot 02a169f7-f78f-4417-ad74-c55a4d512247: created successfully Jul 09 05:03:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] group_snapshot 02a169f7-f78f-4417-ad74-c55a4d512247: deleting Jul 09 05:03:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] group_snapshot 02a169f7-f78f-4417-ad74-c55a4d512247: deleting {{(pid=87161) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-e30879aa-8871-495e-b065-acb87eef413c" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-e30879aa-8871-495e-b065-acb87eef413c" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-34675a3e-d17c-4d59-accb-dce97c9454cd" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-34675a3e-d17c-4d59-accb-dce97c9454cd" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Deleting offline snapshot 34675a3e-d17c-4d59-accb-dce97c9454cd of volume e30879aa-8871-495e-b065-acb87eef413c {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] snapshot_file for this snap is: volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e95209-5031-40bd-9b58-9fa42801c26c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:34 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd Jul 09 05:03:34 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Flow 'volume_create_manager' (b57fc68c-1075-4f4f-88c6-2f39f725ce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467094c7-ee69-4f50-afc3-961780ee2d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467094c7-ee69-4f50-afc3-961780ee2d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1361941539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fbd9faee-94e8-48c2-beb5-cf05edb481a2,host='devstack@QuobyteHD#QuobyteHD',id=2ddbfad9-5c29-49a0-acd0-a2821fb929f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11916e24a508446a85e2b0a8b2fc222d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:35Z,use_quota=True,user_id='94a8c466773b4c61a2caf26b801eeb6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae99e772-c769-4f26-9fd9-77b001307004),volume_type_id=ae99e772-c769-4f26-9fd9-77b001307004)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a115125-bf33-4752-ac77-10dff36d330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a115125-bf33-4752-ac77-10dff36d330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97eb62d6-04bb-4145-ad63-41a3a1d2ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97eb62d6-04bb-4145-ad63-41a3a1d2ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ddbfad9-5c29-49a0-acd0-a2821fb929f9', 'volume_name': 'volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624d38f7-65fc-4004-b96c-b91ab5c9bd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624d38f7-65fc-4004-b96c-b91ab5c9bd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a8d260-ee17-4359-a617-d46544522908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Volume 2ddbfad9-5c29-49a0-acd0-a2821fb929f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9', 'volume_size': 1} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fbd9faee-94e8-48c2-beb5-cf05edb481a2,created_at=2026-07-09T03:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1361941539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fbd9faee-94e8-48c2-beb5-cf05edb481a2,host='devstack@QuobyteHD#QuobyteHD',id=2ddbfad9-5c29-49a0-acd0-a2821fb929f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11916e24a508446a85e2b0a8b2fc222d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:35Z,use_quota=True,user_id='94a8c466773b4c61a2caf26b801eeb6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae99e772-c769-4f26-9fd9-77b001307004),volume_type_id=ae99e772-c769-4f26-9fd9-77b001307004)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Creating volume 2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:03:34 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:03:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:34 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 1073741824 Jul 09 05:03:34 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:35 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd" returned: 0 in 1.373s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e30879aa-8871-495e-b065-acb87eef413c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf887241-dafd-4738-a17a-6a0928afbfc2]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Flow 'volume_create_manager' (d6978164-87d3-48f7-87ee-afb07f0f2750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c47820-aa02-4258-b576-b614634d9bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:35 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c Jul 09 05:03:35 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c47820-aa02-4258-b576-b614634d9bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-78347564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc926a7-d2ef-457b-9348-bd7060e7461c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6568d75c88db43f1ae4b669bd5689f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:36Z,use_quota=True,user_id='9fa125e577ad42a2aba590b78d72b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7eb1711-f143-4428-86fd-2d821873e03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7eb1711-f143-4428-86fd-2d821873e03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f68abe-d4e6-4e35-991d-30a6d83464be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f68abe-d4e6-4e35-991d-30a6d83464be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc926a7-d2ef-457b-9348-bd7060e7461c', 'volume_name': 'volume-8cc926a7-d2ef-457b-9348-bd7060e7461c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4deebf3-37b8-47ca-9ed5-ab9085f260ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4deebf3-37b8-47ca-9ed5-ab9085f260ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c530b6d4-49e7-4b54-a3f3-21a1b6495983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:35 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Volume 8cc926a7-d2ef-457b-9348-bd7060e7461c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc926a7-d2ef-457b-9348-bd7060e7461c', 'volume_size': 1} Jul 09 05:03:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:36 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 1073741824" returned: 0 in 1.250s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:36 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 Jul 09 05:03:36 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:36 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c" returned: 0 in 1.006s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:36 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd Jul 09 05:03:36 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:36 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9" returned: 0 in 0.715s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.033s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-78347564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc926a7-d2ef-457b-9348-bd7060e7461c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6568d75c88db43f1ae4b669bd5689f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:36Z,use_quota=True,user_id='9fa125e577ad42a2aba590b78d72b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Creating volume 8cc926a7-d2ef-457b-9348-bd7060e7461c {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:03:36 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:36 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c 1073741824 Jul 09 05:03:36 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a8d260-ee17-4359-a617-d46544522908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f5909f-cb88-4305-a3e4-081f2e3fb447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:36 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Volume volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 (2ddbfad9-5c29-49a0-acd0-a2821fb929f9): created successfully Jul 09 05:03:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f5909f-cb88-4305-a3e4-081f2e3fb447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Flow 'volume_create_manager' (b57fc68c-1075-4f4f-88c6-2f39f725ce67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:37 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-da9d6f0f-2e3e-4dd0-9aa7-3d1cb22a2829 tempest-GroupsV314Test-637771251 None] Created volume successfully. Jul 09 05:03:37 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd" returned: 0 in 0.979s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:37 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd Jul 09 05:03:37 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:38 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c 1073741824" returned: 0 in 1.144s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:38 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c Jul 09 05:03:38 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:38 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c.34675a3e-d17c-4d59-accb-dce97c9454cd" returned: 0 in 0.986s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-34675a3e-d17c-4d59-accb-dce97c9454cd" released by "_delete_snapshot" :: held 4.504s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-e30879aa-8871-495e-b065-acb87eef413c" released by "delete_snapshot" :: held 4.552s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-ef824458-5871-4c4d-9e6d-c8dabce44108" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-ef824458-5871-4c4d-9e6d-c8dabce44108" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Deleting offline snapshot ef824458-5871-4c4d-9e6d-c8dabce44108 of volume bf20a2c2-09fa-45f6-b588-3fb963ec0b21 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] snapshot_file for this snap is: volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0235bc-3d89-4730-8a8b-c142f2b44a2a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:38 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 Jul 09 05:03:38 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:38 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c" returned: 0 in 0.871s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c530b6d4-49e7-4b54-a3f3-21a1b6495983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc926a7-d2ef-457b-9348-bd7060e7461c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36efba9-09c3-4798-9445-181f212e0dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:38 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Volume volume-8cc926a7-d2ef-457b-9348-bd7060e7461c (8cc926a7-d2ef-457b-9348-bd7060e7461c): created successfully Jul 09 05:03:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36efba9-09c3-4798-9445-181f212e0dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Flow 'volume_create_manager' (d6978164-87d3-48f7-87ee-afb07f0f2750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:39 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4c483ed6-f1a2-4edd-8a5b-2021e907421b tempest-VolumesDeleteCascade-164553841 None] Created volume successfully. Jul 09 05:03:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:03:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:39 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:03:39 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:39 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108" returned: 0 in 1.235s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:40 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Cloning volume 2ddbfad9-5c29-49a0-acd0-a2821fb929f9 to volume c6056761-d128-42c9-81f3-5f567b3571c1 Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0497beb7-1c25-450c-b557-5e00c8974022]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Creating offline snapshot 4e4c859d-72bb-450e-b30b-17e740e1ce36 of volume 2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[850e5ac2-bcbf-45f4-ab2d-2acb0dd5c127]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:40 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.245s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 8 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:03:40 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 Jul 09 05:03:40 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:40 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 Jul 09 05:03:40 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:41 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" returned: 0 in 1.129s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:41 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 Jul 09 05:03:41 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:41 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9" returned: 0 in 1.003s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:41 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 1G Jul 09 05:03:41 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:42 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108" returned: 0 in 0.799s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:42 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108 Jul 09 05:03:42 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:42 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 1G" returned: 0 in 0.836s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:42 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 Jul 09 05:03:42 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:42 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21.ef824458-5871-4c4d-9e6d-c8dabce44108" returned: 0 in 0.679s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-ef824458-5871-4c4d-9e6d-c8dabce44108" released by "_delete_snapshot" :: held 4.033s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" released by "delete_snapshot" :: held 4.072s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:42 devstack cinder-volume[87161]: WARNING cinder.quota [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1976142230 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1976142230, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:03:42 devstack cinder-volume[87161]: WARNING cinder.quota [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1976142230 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1976142230, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:03:42 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36" returned: 0 in 0.788s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:42 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:03:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:42 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['9b77972e-35e4-4fa7-a389-ce9b24de8c95', '751011ea-e628-4ddd-9014-81dfeb96f13d', '86fd5ac1-bd88-4e51-8f75-c2a51b14bcc5', '97b4abf4-82ee-47ba-a010-c59f0f3a906e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:42 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 Jul 09 05:03:42 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:43 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['8db5ac85-3040-4bea-afc6-6aa3baecba65', '049fd957-4060-450d-9858-cae8e7547944', '755f39a1-d645-4851-b47f-6eb2588ab528', 'd3d6dc07-198a-44e9-8290-a08b3fefe717'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:43 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-95a8fac2-c2d8-482d-905d-e0ed69034c8e tempest-GroupSnapshotsTest-1411288932 None] group_snapshot 02a169f7-f78f-4417-ad74-c55a4d512247: deleted successfully Jul 09 05:03:43 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36" returned: 0 in 0.686s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" acquired by "delete_volume" :: waited 0.035s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:43 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.info Jul 09 05:03:43 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e865bd-4b0f-49a5-8e05-0c73c1192b87]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:43 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 Jul 09 05:03:43 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:44 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.info" returned: 0 in 0.809s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:44 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:03:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:44 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.info Jul 09 05:03:44 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:44 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" returned: 0 in 0.843s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:44 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21 Jul 09 05:03:44 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:45 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.info" returned: 0 in 0.649s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Acquiring lock "cinder-quobyte-c6056761-d128-42c9-81f3-5f567b3571c1" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Lock "cinder-quobyte-c6056761-d128-42c9-81f3-5f567b3571c1" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] snapshot: 4e4c859d-72bb-450e-b30b-17e740e1ce36, volume: c6056761-d128-42c9-81f3-5f567b3571c1, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd11851-7ecd-4872-94a9-ea9f726aefde]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:45 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" returned: 0 in 0.692s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-bf20a2c2-09fa-45f6-b588-3fb963ec0b21" released by "delete_volume" :: held 1.628s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-e30879aa-8871-495e-b065-acb87eef413c" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-e30879aa-8871-495e-b065-acb87eef413c" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:45 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 Jul 09 05:03:45 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f95018d-c7ff-4243-962d-bf89f36495b3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:45 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c Jul 09 05:03:45 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:45 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36" returned: 0 in 0.779s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8583b87-7dfd-468b-be55-7e67986fae24]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:46 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 Jul 09 05:03:46 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:46 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c" returned: 0 in 0.844s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:46 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c Jul 09 05:03:46 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:46 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9" returned: 0 in 0.844s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:46 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:03:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:46 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 Jul 09 05:03:46 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:46 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e30879aa-8871-495e-b065-acb87eef413c" returned: 0 in 0.701s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-e30879aa-8871-495e-b065-acb87eef413c" released by "delete_volume" :: held 1.608s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:46 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['1deac211-2c1c-436d-8f09-c1d58b2bce5c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:47 devstack cinder-volume[87161]: WARNING cinder.quota [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1976142230 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1976142230, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:03:47 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['53f5051a-1960-480b-babb-1983a9c2e039', '2f433e84-c34d-48f7-9b35-9612064c588d', '039e8687-18d0-4555-bc22-48ae1909a336', '097d40e6-a094-4b92-9c81-3980db5b5a96'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:47 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['364a4cba-f9b0-4a4d-bf3e-03d21352d1ed', 'f34ba12e-be36-4b95-a223-0711796399a1', 'f9355d2d-6a0b-4542-aeee-012186c0d7ea', '4a525f0a-3dee-43f2-a534-0d50597a026e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:47 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:03:47 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:47 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-862186f0-3d79-4ea3-b815-c0a031d24155 tempest-GroupSnapshotsTest-1411288932 None] Group tempest-GroupSnapshotsTest-Group-426677899: creating Jul 09 05:03:47 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-862186f0-3d79-4ea3-b815-c0a031d24155 tempest-GroupSnapshotsTest-1411288932 None] Group tempest-GroupSnapshotsTest-Group-426677899: created successfully Jul 09 05:03:47 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-862186f0-3d79-4ea3-b815-c0a031d24155 tempest-GroupSnapshotsTest-1411288932 None] Create group completed successfully. Jul 09 05:03:48 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.936s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:48 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:03:48 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-48e6c677-67b6-4eba-b9d3-e235c5313a3c tempest-GroupSnapshotsTest-1411288932 None] Delete group completed successfully. Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:INSERT=27,cinder:UPDATE=118,cinder:SELECT=112,cinder:DELETE=5 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=112,cinder:INSERT=31,cinder:UPDATE=122,cinder:DELETE=5 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Flow 'volume_create_manager' (88f2092e-4f86-46ac-b36e-28163d4d8e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243a3990-37eb-4d0d-bf55-7c0f2e79badb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243a3990-37eb-4d0d-bf55-7c0f2e79badb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-104633389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af9589d6-9aa1-446b-a28a-4b00fec4ca47,host='devstack@QuobyteHD#QuobyteHD',id=eb6a3f1a-1205-454a-b411-0df0aff4fc5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfe3b4fbe9b4b35bb2094ed5dfd128c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:50Z,use_quota=True,user_id='b08a7a264cfa459c8a65787d41927f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d28893f-6a6c-4ddc-956b-17aa7d0ebb57),volume_type_id=4d28893f-6a6c-4ddc-956b-17aa7d0ebb57)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2d3243-860c-49ca-ad28-19236d8ac08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2d3243-860c-49ca-ad28-19236d8ac08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f89407b-226d-4693-8c4e-0c91cc9ddfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f89407b-226d-4693-8c4e-0c91cc9ddfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6a3f1a-1205-454a-b411-0df0aff4fc5a', 'volume_name': 'volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c369ba4b-7797-4ae9-a9d1-ce6d9eb77908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c369ba4b-7797-4ae9-a9d1-ce6d9eb77908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992e5812-4b58-4ea0-ba2e-d3f8f303cbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:50 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Volume eb6a3f1a-1205-454a-b411-0df0aff4fc5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a', 'volume_size': 1} Jul 09 05:03:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:52 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1" returned: 0 in 5.220s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:52 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ade2859-bb6e-4d05-b03a-9bdd0888edac]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:52 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 Jul 09 05:03:52 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:52 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9" returned: 0 in 0.915s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:52 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:03:52 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Converted 1024.00 MB image at 196.15 MB/s Jul 09 05:03:52 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:03:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:53 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 Jul 09 05:03:53 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:53 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1" returned: 0 in 0.608s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Lock "cinder-quobyte-c6056761-d128-42c9-81f3-5f567b3571c1" released by "_copy_volume_from_snapshot" :: held 8.457s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Acquiring lock "cinder-quobyte-4e4c859d-72bb-450e-b30b-17e740e1ce36" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Lock "cinder-quobyte-4e4c859d-72bb-450e-b30b-17e740e1ce36" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Deleting offline snapshot 4e4c859d-72bb-450e-b30b-17e740e1ce36 of volume 2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:03:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] snapshot_file for this snap is: volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:03:53 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f17279-cfa9-47a3-9395-28ac948b41ff]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:53 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 Jul 09 05:03:53 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:54 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36" returned: 0 in 0.736s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:03:54 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a713f63f-9928-4824-9e50-ec087650c2b3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:54 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 Jul 09 05:03:54 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:55 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:55 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 Jul 09 05:03:55 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:55 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36" returned: 0 in 0.720s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:55 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36 Jul 09 05:03:55 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:56 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9.4e4c859d-72bb-450e-b30b-17e740e1ce36" returned: 0 in 0.629s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Lock "cinder-quobyte-4e4c859d-72bb-450e-b30b-17e740e1ce36" released by "_delete_snapshot" :: held 2.979s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.566s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.845s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Creating offline snapshot e6e5707b-c828-43f7-ae7a-c25cb88ed671 of volume 8cc926a7-d2ef-457b-9348-bd7060e7461c {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:03:56 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fe1eae-9d3f-4ab2-8003-fdc8f79b9e12]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4ddb6e47-620a-4c99-895b-faeea86023cd tempest-GroupsV314Test-637771251 None] Create group from source-group-fbd9faee-94e8-48c2-beb5-cf05edb481a2 completed successfully. Jul 09 05:03:56 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c Jul 09 05:03:56 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:57 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c" returned: 0 in 0.744s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:57 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 1G Jul 09 05:03:57 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Acquiring lock "cinder-quobyte-c6056761-d128-42c9-81f3-5f567b3571c1" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:03:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Lock "cinder-quobyte-c6056761-d128-42c9-81f3-5f567b3571c1" acquired by "delete_volume" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:03:57 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9cf635-5738-4806-836f-ee72edb6dd20]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:03:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:58 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 Jul 09 05:03:58 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:58 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 1G" returned: 0 in 0.836s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc926a7-d2ef-457b-9348-bd7060e7461c -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:58 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc926a7-d2ef-457b-9348-bd7060e7461c -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 Jul 09 05:03:58 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:58 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1" returned: 0 in 0.826s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:58 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1 Jul 09 05:03:58 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Flow 'volume_create_manager' (7fe602cc-9ecf-4b1f-952c-9cdc58f1874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75305ec-6c79-4a4c-a5f9-2bfd6416ce0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75305ec-6c79-4a4c-a5f9-2bfd6416ce0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1910430714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd0e2b9-6261-48ce-901b-00a1f271fcd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ced0737b67c4ea387b9881a69008da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:59Z,use_quota=True,user_id='6ef8fae360d746e8bbea63bec52c68a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1028cd18-decf-4e77-9d06-388f0b2def51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1028cd18-decf-4e77-9d06-388f0b2def51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0ca69b-0263-47b0-a654-b2d4da93fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0ca69b-0263-47b0-a654-b2d4da93fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd0e2b9-6261-48ce-901b-00a1f271fcd8', 'volume_name': 'volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbae84e-273c-45cf-9142-6f66d130ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbae84e-273c-45cf-9142-6f66d130ce12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d89c22-7f05-48cd-9121-1c8755d1571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:03:58 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Volume ebd0e2b9-6261-48ce-901b-00a1f271fcd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8', 'volume_size': 1} Jul 09 05:03:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:59 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc926a7-d2ef-457b-9348-bd7060e7461c -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671" returned: 0 in 0.806s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:59 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 is being set with open permissions: ugo+rw Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:59 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 Jul 09 05:03:59 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:59 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c6056761-d128-42c9-81f3-5f567b3571c1" returned: 0 in 0.678s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Lock "cinder-quobyte-c6056761-d128-42c9-81f3-5f567b3571c1" released by "delete_volume" :: held 1.564s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Created reservations ['002dd74e-9341-45dd-a8d9-94f7165e769d'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:59 devstack cinder-volume[87161]: WARNING cinder.quota [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1688681898 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1688681898, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:03:59 devstack cinder-volume[87161]: WARNING cinder.quota [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1688681898 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1688681898, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Created reservations ['c959c1d7-0cdc-4648-9c45-db922301689c', '2ceb47e9-0caa-4c10-9f82-10a232f67825', '6819d21f-419a-4f74-a405-901f0bd552f0', '92009b2d-8f7f-4e9b-822d-324f84d99858'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:59 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671" returned: 0 in 0.659s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:03:59 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:03:59 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:03:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:03:59 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.info Jul 09 05:03:59 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:00 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.671s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:00 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:04:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1e7db1e7-f675-425a-ba05-10e9d5818609 tempest-GroupsV314Test-637771251 None] Delete group completed successfully. Jul 09 05:04:00 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.info" returned: 0 in 0.677s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:00 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.info is being set with open permissions: ugo+rw Jul 09 05:04:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:00 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.info Jul 09 05:04:00 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Acquiring lock "cinder-quobyte-2ddbfad9-5c29-49a0-acd0-a2821fb929f9" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Lock "cinder-quobyte-2ddbfad9-5c29-49a0-acd0-a2821fb929f9" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:00 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0dd376-2f74-4d59-82b7-6bf3cb7146f0]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:00 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 Jul 09 05:04:00 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:01 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.info" returned: 0 in 0.668s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.491s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.718s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=af9589d6-9aa1-446b-a28a-4b00fec4ca47,created_at=2026-07-09T03:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-104633389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af9589d6-9aa1-446b-a28a-4b00fec4ca47,host='devstack@QuobyteHD#QuobyteHD',id=eb6a3f1a-1205-454a-b411-0df0aff4fc5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfe3b4fbe9b4b35bb2094ed5dfd128c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:50Z,use_quota=True,user_id='b08a7a264cfa459c8a65787d41927f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d28893f-6a6c-4ddc-956b-17aa7d0ebb57),volume_type_id=4d28893f-6a6c-4ddc-956b-17aa7d0ebb57)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Creating volume eb6a3f1a-1205-454a-b411-0df0aff4fc5a {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:04:01 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:01 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a 1073741824 Jul 09 05:04:01 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:01 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-05af36f3-fc46-4c23-be6a-a8ea20e3af67 tempest-VolumesDeleteCascade-164553841 None] Create snapshot completed successfully Jul 09 05:04:01 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9" returned: 0 in 0.774s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:01 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9 Jul 09 05:04:01 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:02 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a 1073741824" returned: 0 in 0.937s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:02 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2ddbfad9-5c29-49a0-acd0-a2821fb929f9" returned: 0 in 0.703s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Lock "cinder-quobyte-2ddbfad9-5c29-49a0-acd0-a2821fb929f9" released by "delete_volume" :: held 1.544s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:02 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a Jul 09 05:04:02 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Created reservations ['19d70be5-1918-4fcd-9d04-3b9cd4ad5ef2'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Created reservations ['8dc0be69-1009-4174-94e7-0378efdd75c4', '94eeb68c-2786-4ee3-a9bc-5fcf0d3d3504', 'b6950eb1-61a1-4d5f-ac10-65619ad9c69a', '2a139b86-794d-47d5-9b3c-426a9c1f71c7'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:02 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:04:02 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:02 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" returned: 0 in 0.651s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.888s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1910430714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd0e2b9-6261-48ce-901b-00a1f271fcd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ced0737b67c4ea387b9881a69008da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:03:59Z,use_quota=True,user_id='6ef8fae360d746e8bbea63bec52c68a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Creating volume ebd0e2b9-6261-48ce-901b-00a1f271fcd8 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:04:02 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:02 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 1073741824 Jul 09 05:04:02 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992e5812-4b58-4ea0-ba2e-d3f8f303cbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f43be2-f1ef-45ff-9a8e-805d7d063308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:02 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Volume volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a (eb6a3f1a-1205-454a-b411-0df0aff4fc5a): created successfully Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f43be2-f1ef-45ff-9a8e-805d7d063308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Flow 'volume_create_manager' (88f2092e-4f86-46ac-b36e-28163d4d8e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:02 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b4f9f1f3-9f81-428c-9f2b-a2aa9042a5ed tempest-GroupSnapshotsTest-1411288932 None] Created volume successfully. Jul 09 05:04:03 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.699s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:03 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:04:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-67d7cc13-3781-4da5-8ac7-6cc0cb02baab tempest-GroupsV314Test-637771251 None] Delete group completed successfully. Jul 09 05:04:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] GroupSnapshot e0af12f1-96d2-4791-bf51-c7d36b243220: creating. Jul 09 05:04:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Group snapshot e0af12f1-96d2-4791-bf51-c7d36b243220: creating. {{(pid=87161) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 05:04:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:03 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 1073741824" returned: 0 in 0.919s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:03 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 Jul 09 05:04:03 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:04 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8" returned: 0 in 0.690s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.414s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d89c22-7f05-48cd-9121-1c8755d1571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda809e4-84af-410d-8e80-343f590354ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] Creating offline snapshot 1ba96322-8ae1-4dc8-8d79-f5c50d6df579 of volume 8cc926a7-d2ef-457b-9348-bd7060e7461c {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:04:04 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Volume volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 (ebd0e2b9-6261-48ce-901b-00a1f271fcd8): created successfully Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda809e4-84af-410d-8e80-343f590354ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Flow 'volume_create_manager' (7fe602cc-9ecf-4b1f-952c-9cdc58f1874b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a884befc-b4e6-4cd1-a0a0-5cd7f456e6b4]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-108a5315-8156-48f5-a534-eb29f20a02ad tempest-AttachVolumeTestJSON-1224303337 None] Created volume successfully. Jul 09 05:04:04 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 Jul 09 05:04:04 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:05 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671" returned: 0 in 0.824s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc926a7-d2ef-457b-9348-bd7060e7461c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:04:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:05 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 1G Jul 09 05:04:05 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:06 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 1G" returned: 0 in 0.921s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:06 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 Jul 09 05:04:06 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:06 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579" returned: 0 in 0.683s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:06 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 is being set with open permissions: ugo+rw Jul 09 05:04:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:06 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 Jul 09 05:04:06 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:07 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579" returned: 0 in 0.681s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.245s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.160s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Creating offline snapshot 92bfbd9e-8fe6-490e-a040-381f22f45d08 of volume eb6a3f1a-1205-454a-b411-0df0aff4fc5a {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:04:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-642bd8ae-86ce-4206-a285-e6cdeb327a71 tempest-VolumesDeleteCascade-164553841 None] Create snapshot completed successfully Jul 09 05:04:07 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa300e6-80c5-4a20-a267-e5463874617a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:07 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a Jul 09 05:04:07 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-8cc926a7-d2ef-457b-9348-bd7060e7461c-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-8cc926a7-d2ef-457b-9348-bd7060e7461c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Performing cascade delete. {{(pid=87161) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-1ba96322-8ae1-4dc8-8d79-f5c50d6df579-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-1ba96322-8ae1-4dc8-8d79-f5c50d6df579-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-8cc926a7-d2ef-457b-9348-bd7060e7461c" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-8cc926a7-d2ef-457b-9348-bd7060e7461c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-1ba96322-8ae1-4dc8-8d79-f5c50d6df579" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-1ba96322-8ae1-4dc8-8d79-f5c50d6df579" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Deleting offline snapshot 1ba96322-8ae1-4dc8-8d79-f5c50d6df579 of volume 8cc926a7-d2ef-457b-9348-bd7060e7461c {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] snapshot_file for this snap is: volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[48de31f4-1f15-404d-9e0b-e814cf1d5977]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:08 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-cd30499f-c4dd-41d9-a17e-d6b36c448b7c req-b5dbb3b6-00df-4d75-949c-e24136ed1414 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" returned: 0 in 0.916s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:08 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 1G Jul 09 05:04:08 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:08 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 Jul 09 05:04:08 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:09 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579" returned: 0 in 0.828s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc926a7-d2ef-457b-9348-bd7060e7461c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:04:09 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[603e6477-6e7a-44c5-8435-8704629f37e0]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:09 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 1G" returned: 0 in 0.888s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:09 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 Jul 09 05:04:09 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:09 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 Jul 09 05:04:09 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:10 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08" returned: 0 in 0.755s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:10 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:04:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:10 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 Jul 09 05:04:10 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:10 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671" returned: 0 in 0.859s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc926a7-d2ef-457b-9348-bd7060e7461c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:04:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:10 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 Jul 09 05:04:10 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:11 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08" returned: 0 in 0.767s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:11 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.info Jul 09 05:04:11 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:11 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579" returned: 0 in 0.930s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:11 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579 Jul 09 05:04:11 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:11 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.info" returned: 0 in 0.734s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:11 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:04:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:11 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.info Jul 09 05:04:11 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:12 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.1ba96322-8ae1-4dc8-8d79-f5c50d6df579" returned: 0 in 0.720s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-1ba96322-8ae1-4dc8-8d79-f5c50d6df579" released by "_delete_snapshot" :: held 3.488s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-8cc926a7-d2ef-457b-9348-bd7060e7461c" released by "delete_snapshot" :: held 3.522s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Created reservations ['13ab62b6-19cf-41f6-b183-5350608bbd8d', '464a0a2a-ce82-4f1a-9dd0-ef8d7d36174b', '40bd4694-e559-4adb-b08b-c905569b2d47', '0f3bfcf2-459c-485e-bfdf-e315beeb504c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:12 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Delete snapshot completed successfully. Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-1ba96322-8ae1-4dc8-8d79-f5c50d6df579-delete_snapshot" released by "delete_snapshot" :: held 3.728s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-e6e5707b-c828-43f7-ae7a-c25cb88ed671-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-e6e5707b-c828-43f7-ae7a-c25cb88ed671-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-8cc926a7-d2ef-457b-9348-bd7060e7461c" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-8cc926a7-d2ef-457b-9348-bd7060e7461c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-e6e5707b-c828-43f7-ae7a-c25cb88ed671" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-e6e5707b-c828-43f7-ae7a-c25cb88ed671" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Deleting offline snapshot e6e5707b-c828-43f7-ae7a-c25cb88ed671 of volume 8cc926a7-d2ef-457b-9348-bd7060e7461c {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] snapshot_file for this snap is: volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7248b3ca-762f-4ece-99b4-e66b96676310]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:12 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 Jul 09 05:04:12 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:12 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.info" returned: 0 in 0.704s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.886s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-cd30499f-c4dd-41d9-a17e-d6b36c448b7c req-b5dbb3b6-00df-4d75-949c-e24136ed1414 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.919s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d14630-cb70-40c5-878f-fa435cbb812d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-cd30499f-c4dd-41d9-a17e-d6b36c448b7c req-b5dbb3b6-00df-4d75-949c-e24136ed1414 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:12 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-cfa0fe04-6f0e-4dfd-ada1-37c0762fbb28 tempest-GroupSnapshotsTest-1411288932 None] group_snapshot e0af12f1-96d2-4791-bf51-c7d36b243220: created successfully Jul 09 05:04:12 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 Jul 09 05:04:12 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:13 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671" returned: 0 in 0.857s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc926a7-d2ef-457b-9348-bd7060e7461c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:04:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] group_snapshot e0af12f1-96d2-4791-bf51-c7d36b243220: deleting Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b62b9e-4a92-4202-82b2-b1465e37bc79]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] group_snapshot e0af12f1-96d2-4791-bf51-c7d36b243220: deleting {{(pid=87161) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-92bfbd9e-8fe6-490e-a040-381f22f45d08" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-92bfbd9e-8fe6-490e-a040-381f22f45d08" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Deleting offline snapshot 92bfbd9e-8fe6-490e-a040-381f22f45d08 of volume eb6a3f1a-1205-454a-b411-0df0aff4fc5a {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] snapshot_file for this snap is: volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a5cb1d-5c26-40ec-a466-5559d28ca109]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:13 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c Jul 09 05:04:13 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:13 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 Jul 09 05:04:13 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:13 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-cd30499f-c4dd-41d9-a17e-d6b36c448b7c req-b5dbb3b6-00df-4d75-949c-e24136ed1414 tempest-AttachVolumeTestJSON-1224303337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8" returned: 0 in 0.908s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-cd30499f-c4dd-41d9-a17e-d6b36c448b7c req-b5dbb3b6-00df-4d75-949c-e24136ed1414 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.938s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-cd30499f-c4dd-41d9-a17e-d6b36c448b7c req-b5dbb3b6-00df-4d75-949c-e24136ed1414 tempest-AttachVolumeTestJSON-1224303337 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5933534c-bffb-4f07-9b5f-cd5e16bd2c19', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:04:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-cd30499f-c4dd-41d9-a17e-d6b36c448b7c req-b5dbb3b6-00df-4d75-949c-e24136ed1414 tempest-AttachVolumeTestJSON-1224303337 None] attachment_update completed successfully. Jul 09 05:04:14 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c" returned: 0 in 0.963s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:14 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:14 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 Jul 09 05:04:14 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08" returned: 0 in 0.856s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f58bddd-47c9-4df2-a8ac-88a8bb3d8e9b]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:14 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a Jul 09 05:04:14 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Flow 'volume_create_manager' (f78c1011-3065-4a36-9f68-44eec2f58a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00e9436-4f55-4be7-bcea-8f6e4378dfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00e9436-4f55-4be7-bcea-8f6e4378dfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1243766775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e408586e-527f-46be-9126-2e824fdd15c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ddc51d2c6f4831814338398f259ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:15Z,use_quota=True,user_id='54d2217db46a4090973112c1d72fe10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fe18246-2f67-443b-b402-7420e14d0f08),volume_type_id=6fe18246-2f67-443b-b402-7420e14d0f08)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939b4dd4-962f-4764-99ec-f4f76730c6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939b4dd4-962f-4764-99ec-f4f76730c6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac760f1-1d70-480d-87b8-d7b04ec7647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac760f1-1d70-480d-87b8-d7b04ec7647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e408586e-527f-46be-9126-2e824fdd15c6', 'volume_name': 'volume-e408586e-527f-46be-9126-2e824fdd15c6', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb560d0a-d886-4818-9cea-ac8ff116ee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb560d0a-d886-4818-9cea-ac8ff116ee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68325a6f-9a03-4e3b-a099-73c496185ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:14 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Volume e408586e-527f-46be-9126-2e824fdd15c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e408586e-527f-46be-9126-2e824fdd15c6', 'volume_size': 1} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1243766775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e408586e-527f-46be-9126-2e824fdd15c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ddc51d2c6f4831814338398f259ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:15Z,use_quota=True,user_id='54d2217db46a4090973112c1d72fe10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fe18246-2f67-443b-b402-7420e14d0f08),volume_type_id=6fe18246-2f67-443b-b402-7420e14d0f08)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Creating volume e408586e-527f-46be-9126-2e824fdd15c6 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:04:14 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:04:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:14 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6 1073741824 Jul 09 05:04:14 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:15 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671" returned: 0 in 0.874s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:15 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671 Jul 09 05:04:15 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:15 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" returned: 0 in 0.856s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:15 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 Jul 09 05:04:15 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:15 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c.e6e5707b-c828-43f7-ae7a-c25cb88ed671" returned: 0 in 0.704s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-e6e5707b-c828-43f7-ae7a-c25cb88ed671" released by "_delete_snapshot" :: held 3.507s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-8cc926a7-d2ef-457b-9348-bd7060e7461c" released by "delete_snapshot" :: held 3.533s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:15 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6 1073741824" returned: 0 in 0.890s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Created reservations ['3b5338d5-b801-4664-90e9-c7e5c1567ff4', '6f8e2ba8-2555-4273-8b55-b1a1bb793ed1', '98beeef1-d5f3-4bc0-ab08-c53dd4ad5732', 'f13e8972-e642-451a-b5d6-24a38e83ca27'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:15 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6 Jul 09 05:04:15 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:15 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08" returned: 0 in 0.796s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:15 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08 Jul 09 05:04:15 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:15 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Delete snapshot completed successfully. Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-e6e5707b-c828-43f7-ae7a-c25cb88ed671-delete_snapshot" released by "delete_snapshot" :: held 3.739s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Snapshots deleted, issuing volume delete {{(pid=87161) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 05:04:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-8cc926a7-d2ef-457b-9348-bd7060e7461c" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-8cc926a7-d2ef-457b-9348-bd7060e7461c" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbe0f49-0940-4b50-8939-5a7baf33ffe5]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:16 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c Jul 09 05:04:16 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:16 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6" returned: 0 in 0.702s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68325a6f-9a03-4e3b-a099-73c496185ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e408586e-527f-46be-9126-2e824fdd15c6', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56e9d02-f281-4d15-b0f3-31e79e56c3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:16 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a.92bfbd9e-8fe6-490e-a040-381f22f45d08" returned: 0 in 0.716s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:16 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Volume volume-e408586e-527f-46be-9126-2e824fdd15c6 (e408586e-527f-46be-9126-2e824fdd15c6): created successfully Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56e9d02-f281-4d15-b0f3-31e79e56c3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Flow 'volume_create_manager' (f78c1011-3065-4a36-9f68-44eec2f58a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-92bfbd9e-8fe6-490e-a040-381f22f45d08" released by "_delete_snapshot" :: held 3.369s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" released by "delete_snapshot" :: held 3.408s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1e97492f-ad12-47e4-8ffb-0d48f67dbe4b tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Created volume successfully. Jul 09 05:04:16 devstack cinder-volume[87161]: WARNING cinder.quota [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1002446878 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1002446878, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:04:16 devstack cinder-volume[87161]: WARNING cinder.quota [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1002446878 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1002446878, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['851288a2-469d-4f26-bb32-78c4fed64759', 'bd37c14a-66f0-4b20-9c73-c9ad91f3f397', 'd20dfa10-af2f-4c94-b861-cc7a7e2f0884', '63edc1b3-695a-44a0-8cea-22dcf21202d8'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3ab4f956-9ba5-41d2-b9ae-87ca98f316e2 tempest-GroupSnapshotsTest-1411288932 None] group_snapshot e0af12f1-96d2-4791-bf51-c7d36b243220: deleted successfully Jul 09 05:04:16 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c" returned: 0 in 0.922s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:17 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c Jul 09 05:04:17 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-72774ef0-b744-432a-be73-0b898238449e tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-72774ef0-b744-432a-be73-0b898238449e tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-72774ef0-b744-432a-be73-0b898238449e tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-72774ef0-b744-432a-be73-0b898238449e tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-72774ef0-b744-432a-be73-0b898238449e tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-72774ef0-b744-432a-be73-0b898238449e tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:17 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:04:17 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:17 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8cc926a7-d2ef-457b-9348-bd7060e7461c" returned: 0 in 0.709s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-8cc926a7-d2ef-457b-9348-bd7060e7461c" released by "delete_volume" :: held 1.717s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Created reservations ['f924f5b8-8998-4531-9ad6-bd90e67080ce', '350b1bfb-e3a2-41af-9aaf-4a04fa495e79', 'e5b79c00-dbad-4ff2-b402-7ca5271a6650', '1ec9839a-79a9-4c4d-9b41-ecd0ac3c6de7'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:17 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:04:17 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:18 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-72774ef0-b744-432a-be73-0b898238449e tempest-VolumeRetypeWithoutMigrationTest-331229642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.784s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-72774ef0-b744-432a-be73-0b898238449e tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:04:18 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-72774ef0-b744-432a-be73-0b898238449e tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Retype volume completed successfully. Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "cinder-quobyte-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6c5a9f-f95f-4cfd-a5d8-ac8fc3e1faa3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:18 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a Jul 09 05:04:18 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Acquiring lock "cinder-e408586e-527f-46be-9126-2e824fdd15c6-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "cinder-e408586e-527f-46be-9126-2e824fdd15c6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:18 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.897s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Acquiring lock "cinder-quobyte-e408586e-527f-46be-9126-2e824fdd15c6" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:18 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Deleted volume successfully. Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "cinder-quobyte-e408586e-527f-46be-9126-2e824fdd15c6" acquired by "delete_volume" :: waited 0.027s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b059a075-5b67-4367-b829-443ca14b3def tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-8cc926a7-d2ef-457b-9348-bd7060e7461c-delete_volume" released by "delete_volume" :: held 10.442s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d6b30-acc6-4827-97d5-b8a2acd288e0]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:18 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6 Jul 09 05:04:18 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Flow 'volume_create_manager' (5f87356b-a643-4613-81ef-b5c0d72dcfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d24d90b-22e6-4e7e-a947-1abae84c5620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d24d90b-22e6-4e7e-a947-1abae84c5620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1475984045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924bd535-5e38-4312-a6ff-a7284d41a4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6568d75c88db43f1ae4b669bd5689f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:19Z,use_quota=True,user_id='9fa125e577ad42a2aba590b78d72b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2043ee2-7ca6-4168-8e00-14f890b8f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2043ee2-7ca6-4168-8e00-14f890b8f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95630cef-0f4b-435f-9036-5062c8d257ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95630cef-0f4b-435f-9036-5062c8d257ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924bd535-5e38-4312-a6ff-a7284d41a4f4', 'volume_name': 'volume-924bd535-5e38-4312-a6ff-a7284d41a4f4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99269932-6b4a-4499-844f-b3231c48ecb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99269932-6b4a-4499-844f-b3231c48ecb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06dcdaa-9f93-4e29-8cac-8b2a88e0acd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:19 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Volume 924bd535-5e38-4312-a6ff-a7284d41a4f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924bd535-5e38-4312-a6ff-a7284d41a4f4', 'volume_size': 1} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1475984045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924bd535-5e38-4312-a6ff-a7284d41a4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6568d75c88db43f1ae4b669bd5689f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:19Z,use_quota=True,user_id='9fa125e577ad42a2aba590b78d72b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Creating volume 924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:19 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:04:19 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" returned: 0 in 1.039s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:19 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 1073741824 Jul 09 05:04:19 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:19 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a Jul 09 05:04:19 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:19 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6" returned: 0 in 0.862s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:19 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6 Jul 09 05:04:19 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:20 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" returned: 0 in 0.823s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Lock "cinder-quobyte-eb6a3f1a-1205-454a-b411-0df0aff4fc5a" released by "delete_volume" :: held 1.949s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['6c95b10e-4830-4355-9cfb-7606e5cdce94'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:20 devstack cinder-volume[87161]: WARNING cinder.quota [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1002446878 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1002446878, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Created reservations ['d34a592b-f6b8-424b-9a2f-a4a9f5fd535e', '3ccd3a4a-1bf8-45b9-8b0a-34f27386c6b7', 'b7d64e3d-c64a-43d1-a874-9fa3c666324c', '528bf8ec-0bbe-4f17-a082-2e584683b19f'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:20 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:04:20 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:20 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 1073741824" returned: 0 in 1.145s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:20 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e408586e-527f-46be-9126-2e824fdd15c6" returned: 0 in 0.870s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:20 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "cinder-quobyte-e408586e-527f-46be-9126-2e824fdd15c6" released by "delete_volume" :: held 1.788s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:20 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:20 devstack cinder-volume[87161]: WARNING cinder.quota [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:04:20 devstack cinder-volume[87161]: WARNING cinder.quota [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Created reservations ['e392b1a4-8d29-4e41-8c4f-8f61f32c32d5', 'b50c25e8-1f41-4406-b149-2ade0a19b959', '2eb8ae12-46e8-4d78-b309-1ca3dd3502bd', 'c82e4fa5-68a6-473b-a1ca-44debe3d9ac8'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:20 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:04:20 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:21 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.833s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:04:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b4be83b8-2cf8-4f21-990b-9948e871a18e tempest-GroupSnapshotsTest-1411288932 None] Delete group completed successfully. Jul 09 05:04:21 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4" returned: 0 in 0.910s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06dcdaa-9f93-4e29-8cac-8b2a88e0acd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924bd535-5e38-4312-a6ff-a7284d41a4f4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e2a42e-45fd-42fb-8e96-6208756708ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:21 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Volume volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 (924bd535-5e38-4312-a6ff-a7284d41a4f4): created successfully Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e2a42e-45fd-42fb-8e96-6208756708ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Flow 'volume_create_manager' (5f87356b-a643-4613-81ef-b5c0d72dcfd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b9600267-0ccc-4fae-9d36-7585e5b92c52 tempest-VolumesDeleteCascade-164553841 None] Created volume successfully. Jul 09 05:04:21 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.943s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:04:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Deleted volume successfully. Jul 09 05:04:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d70f00e0-8a4b-4477-8394-0366e3aa25cd tempest-VolumeRetypeWithoutMigrationTest-331229642 None] Lock "cinder-e408586e-527f-46be-9126-2e824fdd15c6-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Creating offline snapshot 10f84680-84b5-4b00-a229-6973ab415c81 of volume 924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:04:22 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc39f82d-87c7-4e45-81c3-dbea816d519c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:22 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 Jul 09 05:04:22 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:23 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4" returned: 0 in 0.992s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:23 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 1G Jul 09 05:04:23 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:24 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 1G" returned: 0 in 0.983s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:24 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 Jul 09 05:04:24 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:25 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81" returned: 0 in 0.759s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:25 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 is being set with open permissions: ugo+rw Jul 09 05:04:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:25 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 Jul 09 05:04:25 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:26 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81" returned: 0 in 0.701s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:26 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.info Jul 09 05:04:26 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:26 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.info" returned: 0 in 0.673s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:26 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.info is being set with open permissions: ugo+rw Jul 09 05:04:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:26 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.info Jul 09 05:04:26 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:27 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d774a594-f83c-42f7-bd5b-823a21d9a781 tempest-GroupSnapshotsV319Test-83726707 None] Group tempest-GroupSnapshotsV319Test-Group-1387628025: creating Jul 09 05:04:27 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d774a594-f83c-42f7-bd5b-823a21d9a781 tempest-GroupSnapshotsV319Test-83726707 None] Group tempest-GroupSnapshotsV319Test-Group-1387628025: created successfully Jul 09 05:04:27 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d774a594-f83c-42f7-bd5b-823a21d9a781 tempest-GroupSnapshotsV319Test-83726707 None] Create group completed successfully. Jul 09 05:04:27 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.info" returned: 0 in 0.975s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.201s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-bba80a6a-47ff-4fec-905a-101704a9fd3f tempest-VolumesDeleteCascade-164553841 None] Create snapshot completed successfully Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Flow 'volume_create_manager' (5e9dded4-d1a4-442e-ae88-864f35b4dd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7644caaa-c855-485a-8eaa-d28844c13f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7644caaa-c855-485a-8eaa-d28844c13f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1287019645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a526d0df-7d35-4dc3-aa64-eeaf199bcd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='096c31ff2fab41c5bf1eb13e4dc16ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:28Z,use_quota=True,user_id='32a5f47c77cb4a56a8ac85a61630bc7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcc67e8-5ace-4450-b0dd-d3043bd64bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcc67e8-5ace-4450-b0dd-d3043bd64bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1c8e96-0771-4044-bfef-3af659895ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1c8e96-0771-4044-bfef-3af659895ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a526d0df-7d35-4dc3-aa64-eeaf199bcd9f', 'volume_name': 'volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531cb5c0-4e36-4822-8b07-d05de2e2487a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531cb5c0-4e36-4822-8b07-d05de2e2487a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813bf4a8-84e7-4f9a-aa40-a91c04ccfa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:28 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Volume a526d0df-7d35-4dc3-aa64-eeaf199bcd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f', 'volume_size': 1} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1287019645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a526d0df-7d35-4dc3-aa64-eeaf199bcd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='096c31ff2fab41c5bf1eb13e4dc16ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:28Z,use_quota=True,user_id='32a5f47c77cb4a56a8ac85a61630bc7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Creating volume a526d0df-7d35-4dc3-aa64-eeaf199bcd9f {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:04:28 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:04:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:28 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f 1073741824 Jul 09 05:04:28 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Flow 'volume_create_manager' (844ba39b-eb08-45bb-934c-bb800e8b7619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f50dd6-1a82-4a83-b1e1-715329d2bef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:29 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f 1073741824" returned: 0 in 1.008s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f50dd6-1a82-4a83-b1e1-715329d2bef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120543485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dffd22b-14c8-42ee-90ba-8ee94828979d,host='devstack@QuobyteHD#QuobyteHD',id=ac4c4136-c9dc-46de-8570-4682cf8f6edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf392f4d7f84aa69b1663b27c8cc1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:29Z,use_quota=True,user_id='58a76f25a1ab478c95a412ba9e8ed997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be5cac9a-3d98-4ffb-9e1a-f4895316ebee),volume_type_id=be5cac9a-3d98-4ffb-9e1a-f4895316ebee)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b17c97b-825d-4fe5-acc0-6cc4425bbca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b17c97b-825d-4fe5-acc0-6cc4425bbca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a491a8b7-e1f7-46f9-ad6f-7dbf9c604087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a491a8b7-e1f7-46f9-ad6f-7dbf9c604087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac4c4136-c9dc-46de-8570-4682cf8f6edd', 'volume_name': 'volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b239fe-0dc6-46d7-8ebd-1ac048e7ee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b239fe-0dc6-46d7-8ebd-1ac048e7ee25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea8e8ea-1a9b-4a64-95fd-521e5298c73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:29 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Volume ac4c4136-c9dc-46de-8570-4682cf8f6edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd', 'volume_size': 1} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:04:29 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f Jul 09 05:04:29 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Flow 'volume_create_manager' (24459099-0990-45b2-bfd9-411c9f344f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05d865f-35c5-4462-8f79-3f2d9ff07a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05d865f-35c5-4462-8f79-3f2d9ff07a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1815967221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6568d75c88db43f1ae4b669bd5689f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10f84680-84b5-4b00-a229-6973ab415c81,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:30Z,use_quota=True,user_id='9fa125e577ad42a2aba590b78d72b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972ff70a-2475-40d1-b875-0ddaeca76444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972ff70a-2475-40d1-b875-0ddaeca76444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f5f284-a9e1-40e5-945a-591ba440f231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f5f284-a9e1-40e5-945a-591ba440f231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce', 'volume_name': 'volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce', 'volume_size': 1, 'snapshot_id': '10f84680-84b5-4b00-a229-6973ab415c81'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e75eae-763b-4fe5-8014-73dc2e32c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e75eae-763b-4fe5-8014-73dc2e32c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6befc70c-62eb-41ce-ad12-30aecef76655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:29 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Volume 598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce', 'volume_size': 1, 'snapshot_id': '10f84680-84b5-4b00-a229-6973ab415c81'} Jul 09 05:04:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:30 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" returned: 0 in 0.679s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2dffd22b-14c8-42ee-90ba-8ee94828979d,created_at=2026-07-09T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120543485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dffd22b-14c8-42ee-90ba-8ee94828979d,host='devstack@QuobyteHD#QuobyteHD',id=ac4c4136-c9dc-46de-8570-4682cf8f6edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf392f4d7f84aa69b1663b27c8cc1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:29Z,use_quota=True,user_id='58a76f25a1ab478c95a412ba9e8ed997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be5cac9a-3d98-4ffb-9e1a-f4895316ebee),volume_type_id=be5cac9a-3d98-4ffb-9e1a-f4895316ebee)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Creating volume ac4c4136-c9dc-46de-8570-4682cf8f6edd {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:04:30 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813bf4a8-84e7-4f9a-aa40-a91c04ccfa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fed11d9-7430-4584-9301-2f4488d81a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:30 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd 1073741824 Jul 09 05:04:30 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:30 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Volume volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f (a526d0df-7d35-4dc3-aa64-eeaf199bcd9f): created successfully Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fed11d9-7430-4584-9301-2f4488d81a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Flow 'volume_create_manager' (5e9dded4-d1a4-442e-ae88-864f35b4dd33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:30 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e89da90e-9abc-4958-bac0-a7504221ae1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Created volume successfully. Jul 09 05:04:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:31 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd 1073741824" returned: 0 in 1.099s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:31 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd Jul 09 05:04:31 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:32 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd" returned: 0 in 0.850s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.584s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-10f84680-84b5-4b00-a229-6973ab415c81-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" by "_create_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea8e8ea-1a9b-4a64-95fd-521e5298c73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffd231a-bab6-49fd-8341-c9debf5a61ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-10f84680-84b5-4b00-a229-6973ab415c81-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Creating volume 598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce from snapshot 10f84680-84b5-4b00-a229-6973ab415c81 {{(pid=87161) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:32 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Volume volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd (ac4c4136-c9dc-46de-8570-4682cf8f6edd): created successfully Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffd231a-bab6-49fd-8341-c9debf5a61ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Flow 'volume_create_manager' (844ba39b-eb08-45bb-934c-bb800e8b7619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] snapshot: 10f84680-84b5-4b00-a229-6973ab415c81, volume: 598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:04:32 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-37b1b37d-7e60-4ea1-8310-c8c58f1b1f37 tempest-GroupSnapshotsV319Test-83726707 None] Created volume successfully. Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[93daebf9-0e2b-4cb2-aebe-ec3fce7df7f6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:32 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 Jul 09 05:04:32 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:33 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81" returned: 0 in 0.865s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-924bd535-5e38-4312-a6ff-a7284d41a4f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:04:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:04:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:04:33 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[45290d38-1f22-4e57-bfeb-b314356db0c9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] GroupSnapshot 4dca6116-743e-4197-b72c-178d5894a772: creating. Jul 09 05:04:33 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 Jul 09 05:04:33 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Group snapshot 4dca6116-743e-4197-b72c-178d5894a772: creating. {{(pid=87161) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 05:04:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:34 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4" returned: 0 in 0.869s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:34 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:04:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:34 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce Jul 09 05:04:34 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:04:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:39 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:04:39 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:40 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" returned: 0 in 5.962s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f96484-4e35-447c-8ce0-f62d5afbfb9f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:40 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.269s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:40 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:04:40 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:04:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 8 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:04:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:04:40 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 Jul 09 05:04:40 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:41 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4" returned: 0 in 0.955s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:04:41 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Converted 1024.00 MB image at 171.72 MB/s Jul 09 05:04:41 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce is being set with open permissions: ugo+rw Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:41 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce Jul 09 05:04:41 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:41 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" returned: 0 in 0.679s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" released by "_copy_volume_from_snapshot" :: held 9.448s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-10f84680-84b5-4b00-a229-6973ab415c81-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" released by "_create_volume_from_snapshot" :: held 9.488s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.519s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.051s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Creating offline snapshot b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 of volume a526d0df-7d35-4dc3-aa64-eeaf199bcd9f {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c89d03-4ada-4b96-99c1-7652f8c213ca]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6befc70c-62eb-41ce-ad12-30aecef76655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce', 'volume_size': 1, 'snapshot_id': '10f84680-84b5-4b00-a229-6973ab415c81'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342393a4-3332-4bfa-9dc3-e8c44f385e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Volume volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce (598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce): created successfully Jul 09 05:04:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342393a4-3332-4bfa-9dc3-e8c44f385e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Flow 'volume_create_manager' (24459099-0990-45b2-bfd9-411c9f344f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:42 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-bb06e39d-bf6c-4543-986d-746052241e32 tempest-VolumesDeleteCascade-164553841 None] Created volume successfully. Jul 09 05:04:42 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f Jul 09 05:04:42 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:42 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" returned: 0 in 0.822s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:42 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 1G Jul 09 05:04:42 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-924bd535-5e38-4312-a6ff-a7284d41a4f4-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-924bd535-5e38-4312-a6ff-a7284d41a4f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Performing cascade delete. {{(pid=87161) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-10f84680-84b5-4b00-a229-6973ab415c81-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-10f84680-84b5-4b00-a229-6973ab415c81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-924bd535-5e38-4312-a6ff-a7284d41a4f4" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-924bd535-5e38-4312-a6ff-a7284d41a4f4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-10f84680-84b5-4b00-a229-6973ab415c81" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-10f84680-84b5-4b00-a229-6973ab415c81" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Deleting offline snapshot 10f84680-84b5-4b00-a229-6973ab415c81 of volume 924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] snapshot_file for this snap is: volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b43ea0-2c6d-409c-827e-05e0887a8e4a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:43 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 Jul 09 05:04:43 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:43 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 1G" returned: 0 in 0.901s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:43 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 Jul 09 05:04:43 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:44 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81" returned: 0 in 0.831s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-924bd535-5e38-4312-a6ff-a7284d41a4f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:04:44 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[75766c18-96e1-48c4-b717-f5aeb9e25435]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:44 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 Jul 09 05:04:44 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:44 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9" returned: 0 in 0.788s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:44 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 is being set with open permissions: ugo+rw Jul 09 05:04:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:44 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 Jul 09 05:04:44 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:45 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4" returned: 0 in 0.866s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:45 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 Jul 09 05:04:45 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:45 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9" returned: 0 in 0.690s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:45 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.info Jul 09 05:04:45 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:45 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81" returned: 0 in 0.739s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:45 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81 Jul 09 05:04:45 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:45 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.info" returned: 0 in 0.674s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:45 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.info is being set with open permissions: ugo+rw Jul 09 05:04:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:45 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.info Jul 09 05:04:45 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:46 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4.10f84680-84b5-4b00-a229-6973ab415c81" returned: 0 in 0.663s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:46 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.info" returned: 0 in 0.646s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.611s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-10f84680-84b5-4b00-a229-6973ab415c81" released by "_delete_snapshot" :: held 3.194s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.981s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-924bd535-5e38-4312-a6ff-a7284d41a4f4" released by "delete_snapshot" :: held 3.231s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Creating offline snapshot 5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 of volume ac4c4136-c9dc-46de-8570-4682cf8f6edd {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:04:46 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6d27a037-bf6d-4b16-afcf-70335ba44635 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Create snapshot completed successfully Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a59d4ea-08f3-4fec-841f-54e392ce6607]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Created reservations ['a5dd66bc-ef9f-4eed-a38a-72e8fd0d4ace', 'b6ac961a-4e59-46ad-94cf-f6c05eb28959', '38d6bc2c-82ce-4c11-ac93-8db8a2d00938', '8ab52298-0696-4b23-8e02-8b6b0488eea1'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:46 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd Jul 09 05:04:46 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:46 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Delete snapshot completed successfully. Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-10f84680-84b5-4b00-a229-6973ab415c81-delete_snapshot" released by "delete_snapshot" :: held 3.416s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Snapshots deleted, issuing volume delete {{(pid=87161) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-924bd535-5e38-4312-a6ff-a7284d41a4f4" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-924bd535-5e38-4312-a6ff-a7284d41a4f4" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c60a25-3a18-4122-8e67-18e810680f01]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:46 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 Jul 09 05:04:46 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Acquiring lock "cinder-b6027cb2-de1f-4eb9-b388-03aa8b93ddb9-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "cinder-b6027cb2-de1f-4eb9-b388-03aa8b93ddb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Acquiring lock "cinder-quobyte-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "cinder-quobyte-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Acquiring lock "cinder-quobyte-b6027cb2-de1f-4eb9-b388-03aa8b93ddb9" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "cinder-quobyte-b6027cb2-de1f-4eb9-b388-03aa8b93ddb9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Deleting offline snapshot b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 of volume a526d0df-7d35-4dc3-aa64-eeaf199bcd9f {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] snapshot_file for this snap is: volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac72d00-6a00-4076-89cb-e34fbdf8062f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:47 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd" returned: 0 in 0.813s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:47 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 1G Jul 09 05:04:47 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:47 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 Jul 09 05:04:47 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:47 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4" returned: 0 in 0.855s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:47 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4 Jul 09 05:04:47 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:48 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9" returned: 0 in 0.845s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffe510b-72d4-496d-a54f-a66e166cb3c8]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:48 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 1G" returned: 0 in 0.814s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:48 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 Jul 09 05:04:48 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:48 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f Jul 09 05:04:48 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:48 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-924bd535-5e38-4312-a6ff-a7284d41a4f4" returned: 0 in 0.722s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-924bd535-5e38-4312-a6ff-a7284d41a4f4" released by "delete_volume" :: held 1.656s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Created reservations ['71f9cd80-b5de-4168-89c2-55e38f2b21e9', 'c19d8646-19eb-4cbf-8f14-ede6fc3a6842', 'd9358490-a6ed-4d6f-b6e7-751f648bb7eb', 'c807e4f7-c1cf-4888-8e4e-e4e3fb80fa04'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:48 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:04:48 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "cinder-quobyte-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" acquired by "delete_volume" :: waited 0.031s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21989f8-a41e-4d11-91e4-d96b1d68edf3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:49 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648" returned: 0 in 0.816s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:49 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:49 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 Jul 09 05:04:49 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:49 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" returned: 0 in 0.900s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:49 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce Jul 09 05:04:49 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:49 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 Jul 09 05:04:49 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:49 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.749s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:04:49 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Deleted volume successfully. Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f56fac11-a514-4661-980c-454052b12361 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-924bd535-5e38-4312-a6ff-a7284d41a4f4-delete_volume" released by "delete_volume" :: held 6.181s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:49 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648" returned: 0 in 0.692s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:49 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.info Jul 09 05:04:49 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:49 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" returned: 0 in 0.942s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:49 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce Jul 09 05:04:49 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:50 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9" returned: 0 in 0.956s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:50 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9 Jul 09 05:04:50 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:50 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.info" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:50 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:50 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.info Jul 09 05:04:50 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:50 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" returned: 0 in 0.757s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-quobyte-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce" released by "delete_volume" :: held 1.750s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=104,cinder:SELECT=121,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=111,cinder:UPDATE=130,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Created reservations ['3e96c12a-989a-41f9-bfc7-2f5eaf032313', '41047750-4db4-4c18-81e8-5abc33553ddb', 'ee6fe164-90e4-4224-8d1c-2b0269c40fc9', 'bc55d92d-164d-4941-ade0-f9c2b7fac640'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:50 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f.b6027cb2-de1f-4eb9-b388-03aa8b93ddb9" returned: 0 in 0.769s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "cinder-quobyte-b6027cb2-de1f-4eb9-b388-03aa8b93ddb9" released by "_delete_snapshot" :: held 3.597s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "cinder-quobyte-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" released by "delete_snapshot" :: held 3.624s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:50 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:04:50 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:50 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Created reservations ['ad5f253e-5fcd-4526-bacb-b1c650231f9e', '939c3609-4d74-4b38-b0a5-b01c866b3f4b', 'fbf38771-11fa-422b-9627-f75da26fc7d8', 'e2997607-152a-4e69-a6f2-9623f4598ed7'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Delete snapshot completed successfully. Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-662d6f18-92b4-4b96-a22c-13f6dad8c9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "cinder-b6027cb2-de1f-4eb9-b388-03aa8b93ddb9-delete_snapshot" released by "delete_snapshot" :: held 3.799s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:51 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.info" returned: 0 in 0.706s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3b6ebfe2-be25-462f-8665-7e8c7ba7e43a tempest-GroupSnapshotsV319Test-83726707 None] group_snapshot 4dca6116-743e-4197-b72c-178d5894a772: created successfully Jul 09 05:04:51 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Acquiring lock "cinder-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.693s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:04:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Deleted volume successfully. Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "cinder-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e5e50b5-a870-46c3-85c4-18115c5c6324 tempest-VolumesDeleteCascade-164553841 None] Lock "cinder-598aa928-fa4f-4e46-a0ff-0bd9aaf9d4ce-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Acquiring lock "cinder-quobyte-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "cinder-quobyte-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ab8bfe-673f-4cdb-8b4c-11e0e67877b6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:51 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f Jul 09 05:04:51 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:52 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] group_snapshot 4dca6116-743e-4197-b72c-178d5894a772: deleting Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] group_snapshot 4dca6116-743e-4197-b72c-178d5894a772: deleting {{(pid=87161) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Acquiring lock "cinder-quobyte-ac4c4136-c9dc-46de-8570-4682cf8f6edd" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Lock "cinder-quobyte-ac4c4136-c9dc-46de-8570-4682cf8f6edd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Acquiring lock "cinder-quobyte-5afe47b7-b4e9-4320-86c5-3dc0f1ab5648" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Lock "cinder-quobyte-5afe47b7-b4e9-4320-86c5-3dc0f1ab5648" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Deleting offline snapshot 5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 of volume ac4c4136-c9dc-46de-8570-4682cf8f6edd {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] snapshot_file for this snap is: volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[486a0163-505d-4074-b9c1-629883b333ee]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:52 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 Jul 09 05:04:52 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:52 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" returned: 0 in 0.933s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:52 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f Jul 09 05:04:52 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:53 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648" returned: 0 in 1.039s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f2e64-9fce-47af-897a-8561d0fb6cfa]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:53 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" returned: 0 in 0.878s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "cinder-quobyte-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f" released by "delete_volume" :: held 1.884s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:53 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd Jul 09 05:04:53 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Created reservations ['48424dba-5de7-4a53-9c82-2eaf88c56a92', '1113e65e-1597-45f0-a3ed-2227651d673c', '920bfa8c-bfd7-45bc-9f29-b32004a1db02', '4bce1cbc-5740-4c5f-b891-949cc70227a3'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:53 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:04:53 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:54 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd" returned: 0 in 1.109s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:54 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.825s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:04:54 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 Jul 09 05:04:54 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Deleted volume successfully. Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee3d1939-b6fd-48a6-8e89-2d60cae6bd93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1599564501 None] Lock "cinder-a526d0df-7d35-4dc3-aa64-eeaf199bcd9f-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Flow 'volume_create_manager' (a155edbe-794c-478f-8e68-90566b8aeae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e40da0b-2d49-4df9-ab68-af3d6a1c52ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e40da0b-2d49-4df9-ab68-af3d6a1c52ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1766255953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595a8856-f607-4110-b920-d6a5b9129059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7449dbf55d47476fb450a3f9ba8b973d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:55Z,use_quota=True,user_id='30637bad175143f6a2caab0ae322bfd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed810a06-af12-4fe8-bbe4-7c6a257a6bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed810a06-af12-4fe8-bbe4-7c6a257a6bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff744798-6601-45fe-b96c-e0cba64e4e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff744798-6601-45fe-b96c-e0cba64e4e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595a8856-f607-4110-b920-d6a5b9129059', 'volume_name': 'volume-595a8856-f607-4110-b920-d6a5b9129059', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80feb8d-1afd-434e-bf07-464a3fe7a369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80feb8d-1afd-434e-bf07-464a3fe7a369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361d5d98-b1a8-43e5-a1db-d49172609efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:54 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Volume 595a8856-f607-4110-b920-d6a5b9129059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595a8856-f607-4110-b920-d6a5b9129059', 'volume_size': 1} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1766255953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595a8856-f607-4110-b920-d6a5b9129059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7449dbf55d47476fb450a3f9ba8b973d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:04:55Z,use_quota=True,user_id='30637bad175143f6a2caab0ae322bfd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Creating volume 595a8856-f607-4110-b920-d6a5b9129059 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:04:54 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:04:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:55 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059 1073741824 Jul 09 05:04:55 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:55 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648" returned: 0 in 0.917s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:55 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648 Jul 09 05:04:55 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:55 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059 1073741824" returned: 0 in 0.919s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:55 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059 Jul 09 05:04:55 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:56 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd.5afe47b7-b4e9-4320-86c5-3dc0f1ab5648" returned: 0 in 0.717s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Lock "cinder-quobyte-5afe47b7-b4e9-4320-86c5-3dc0f1ab5648" released by "_delete_snapshot" :: held 3.921s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Lock "cinder-quobyte-ac4c4136-c9dc-46de-8570-4682cf8f6edd" released by "delete_snapshot" :: held 3.955s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:56 devstack cinder-volume[87161]: WARNING cinder.quota [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1899866541 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1899866541, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:04:56 devstack cinder-volume[87161]: WARNING cinder.quota [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1899866541 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1899866541, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] Created reservations ['24f1cccc-eecf-4cf4-9f89-2d902ab3daa2', 'eba5e743-af5d-4607-b1eb-e6a1f7958bf9', '67c28fef-5403-4f91-8252-75fc00921d97', '506b849a-27ef-46ff-9afa-52016dec0b64'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5f11107d-8cc7-490c-a7a3-df2b04672361 tempest-GroupSnapshotsV319Test-83726707 None] group_snapshot 4dca6116-743e-4197-b72c-178d5894a772: deleted successfully Jul 09 05:04:56 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059" returned: 0 in 0.728s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361d5d98-b1a8-43e5-a1db-d49172609efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595a8856-f607-4110-b920-d6a5b9129059', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81197896-4341-438d-92ea-576bfc20d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:04:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Volume volume-595a8856-f607-4110-b920-d6a5b9129059 (595a8856-f607-4110-b920-d6a5b9129059): created successfully Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81197896-4341-438d-92ea-576bfc20d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Flow 'volume_create_manager' (a155edbe-794c-478f-8e68-90566b8aeae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:04:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c9cb7538-e377-4348-85fd-2f868296cf66 tempest-VolumesMetadataTest-510270856 None] Created volume successfully. Jul 09 05:04:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-99982b76-d1e1-4f2f-929e-5978f386b89f req-5ce2c9f6-eb3d-4c2d-94c2-878a71c821a2 tempest-AttachVolumeTestJSON-1224303337 None] Terminate volume connection completed successfully. Jul 09 05:04:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-99982b76-d1e1-4f2f-929e-5978f386b89f req-5ce2c9f6-eb3d-4c2d-94c2-878a71c821a2 tempest-AttachVolumeTestJSON-1224303337 None] Deleting attachment 5933534c-bffb-4f07-9b5f-cd5e16bd2c19. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:04:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Acquiring lock "cinder-quobyte-ac4c4136-c9dc-46de-8570-4682cf8f6edd" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Lock "cinder-quobyte-ac4c4136-c9dc-46de-8570-4682cf8f6edd" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:57 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[391743d5-77cf-4580-821f-7c15a9307ae7]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:57 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd Jul 09 05:04:57 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Acquiring lock "cinder-595a8856-f607-4110-b920-d6a5b9129059-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Lock "cinder-595a8856-f607-4110-b920-d6a5b9129059-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:58 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd" returned: 0 in 0.936s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:58 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd Jul 09 05:04:58 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Acquiring lock "cinder-quobyte-595a8856-f607-4110-b920-d6a5b9129059" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:04:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Lock "cinder-quobyte-595a8856-f607-4110-b920-d6a5b9129059" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:04:58 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d312e5d-79ec-431c-9bcd-73f41b358fc0]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:04:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:58 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059 Jul 09 05:04:58 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:58 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ac4c4136-c9dc-46de-8570-4682cf8f6edd" returned: 0 in 0.796s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Lock "cinder-quobyte-ac4c4136-c9dc-46de-8570-4682cf8f6edd" released by "delete_volume" :: held 1.808s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:04:59 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Created reservations ['bd5df58a-e595-41c4-9c88-71cc89e303fc'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:59 devstack cinder-volume[87161]: WARNING cinder.quota [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1899866541 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1899866541, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:04:59 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Created reservations ['d619dd33-5a54-4492-beb2-2427d22c4f9c', 'ab169d34-99fb-4e54-9e8e-7166cdfd7df5', '8d9ac4a0-de41-4a24-8787-5109a8192950', '6f464608-6372-4478-88d7-a3bca557af9e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:04:59 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 09 05:04:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059" returned: 0 in 0.911s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:04:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:59 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059 Jul 09 05:04:59 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:04:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:04:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:04:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:04:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:04:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:04:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:04:59 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:04:59 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:00 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-595a8856-f607-4110-b920-d6a5b9129059" returned: 0 in 0.888s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Lock "cinder-quobyte-595a8856-f607-4110-b920-d6a5b9129059" released by "delete_volume" :: held 1.868s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Created reservations ['89e47fd9-8b50-4908-801d-e6a219ad72cd', '9f8895d2-882e-46d8-b438-2fe727141cb8', '748a75c1-a20d-40db-bb2d-53d65e1ed521', '663055ac-b973-4f60-8901-0be934a17a24'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:05:00 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.970s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-816a4a73-c907-4a2e-a71a-f91b16e526f3 tempest-GroupSnapshotsV319Test-83726707 None] Delete group completed successfully. Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:00 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:05:00 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:00 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.694s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:00 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Deleted volume successfully. Jul 09 05:05:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-12cf2c88-5c7a-418f-a8c2-4eec590c4b18 tempest-VolumesMetadataTest-510270856 None] Lock "cinder-595a8856-f607-4110-b920-d6a5b9129059-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Flow 'volume_create_manager' (e53e747b-dc72-4560-a63f-c82dee54a6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a47338d-a80b-42bc-8196-db7272ceac6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a47338d-a80b-42bc-8196-db7272ceac6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-469837354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e5e1418cf44e0b4f199acd6745a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:07Z,use_quota=True,user_id='50dfa129e9274b2887a2be4268f084bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b07d26-5723-4070-be8d-e7e63a1b4cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b07d26-5723-4070-be8d-e7e63a1b4cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0bd823-d1cb-48a2-8e33-512527007c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0bd823-d1cb-48a2-8e33-512527007c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d', 'volume_name': 'volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f7b733-d1d6-4bcb-9185-4178e5591751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f7b733-d1d6-4bcb-9185-4178e5591751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1816af2-33c6-47dd-baab-ad7959d297c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:07 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Volume 9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d', 'volume_size': 1} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-469837354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e5e1418cf44e0b4f199acd6745a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:07Z,use_quota=True,user_id='50dfa129e9274b2887a2be4268f084bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Creating volume 9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:05:07 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:07 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d 1073741824 Jul 09 05:05:07 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Flow 'volume_create_manager' (3f917ba5-4685-41de-b896-b9f9fe04cf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e980a21-43d8-46b8-9ee9-4c49b4649207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e980a21-43d8-46b8-9ee9-4c49b4649207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-128308328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5606c63-4b93-4980-80b7-0d34a7c91d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ca665bfaf7445cbbc153f76f311818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:08Z,use_quota=True,user_id='1956cd276718454f85d81f3c2a0d3dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea42101-6d81-4226-9737-3a16f6204be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea42101-6d81-4226-9737-3a16f6204be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e24bed-604b-4104-a4e1-31b5b0d3c140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e24bed-604b-4104-a4e1-31b5b0d3c140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5606c63-4b93-4980-80b7-0d34a7c91d26', 'volume_name': 'volume-e5606c63-4b93-4980-80b7-0d34a7c91d26', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2322d0a0-758f-4bbd-94aa-35325be6091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2322d0a0-758f-4bbd-94aa-35325be6091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc2293e-dbec-4dde-81b7-14b9d645a4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:07 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Volume e5606c63-4b93-4980-80b7-0d34a7c91d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5606c63-4b93-4980-80b7-0d34a7c91d26', 'volume_size': 1} Jul 09 05:05:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d 1073741824" returned: 0 in 1.140s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:08 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:08 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d Jul 09 05:05:08 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:09 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d" returned: 0 in 0.705s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-128308328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5606c63-4b93-4980-80b7-0d34a7c91d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ca665bfaf7445cbbc153f76f311818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:08Z,use_quota=True,user_id='1956cd276718454f85d81f3c2a0d3dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Creating volume e5606c63-4b93-4980-80b7-0d34a7c91d26 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:05:09 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:09 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26 1073741824 Jul 09 05:05:09 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1816af2-33c6-47dd-baab-ad7959d297c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8657f71e-dd66-42b8-a346-8a55ee19fc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:09 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Volume volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d (9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d): created successfully Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8657f71e-dd66-42b8-a346-8a55ee19fc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Flow 'volume_create_manager' (e53e747b-dc72-4560-a63f-c82dee54a6f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-107bd759-6568-42c8-a496-3ed1982349d2 tempest-VolumesTransfersV355Test-598921263 None] Created volume successfully. Jul 09 05:05:10 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26 1073741824" returned: 0 in 1.075s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:10 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26 Jul 09 05:05:10 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:11 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26" returned: 0 in 1.277s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] <== create_volume: return (2414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:05:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.417s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc2293e-dbec-4dde-81b7-14b9d645a4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5606c63-4b93-4980-80b7-0d34a7c91d26', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cd0347-f998-4fd1-812e-defd5c3b3aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Volume volume-e5606c63-4b93-4980-80b7-0d34a7c91d26 (e5606c63-4b93-4980-80b7-0d34a7c91d26): created successfully Jul 09 05:05:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cd0347-f998-4fd1-812e-defd5c3b3aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Flow 'volume_create_manager' (3f917ba5-4685-41de-b896-b9f9fe04cf1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b7bd4b99-61f6-490d-a363-873a06800ff5 tempest-AbsoluteLimitsTests-1136192347 None] Created volume successfully. Jul 09 05:05:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5871e0bc-cbd0-48d0-acc6-8ef601090ad1 tempest-VolumesTransfersV355Test-833961042 None] Transfer volume completed successfully. Jul 09 05:05:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Acquiring lock "cinder-e5606c63-4b93-4980-80b7-0d34a7c91d26-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Lock "cinder-e5606c63-4b93-4980-80b7-0d34a7c91d26-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Acquiring lock "cinder-quobyte-e5606c63-4b93-4980-80b7-0d34a7c91d26" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Lock "cinder-quobyte-e5606c63-4b93-4980-80b7-0d34a7c91d26" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf20cc3-c43f-450c-bd60-94d6a2aeb167]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:12 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26 Jul 09 05:05:12 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Acquiring lock "cinder-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Lock "cinder-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Acquiring lock "cinder-quobyte-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Lock "cinder-quobyte-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d" acquired by "delete_volume" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:13 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc0aa1f-18f3-46fe-ad98-ed48e327033d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:13 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26" returned: 0 in 1.275s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:13 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26 Jul 09 05:05:13 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:13 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d Jul 09 05:05:13 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:14 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e5606c63-4b93-4980-80b7-0d34a7c91d26" returned: 0 in 1.105s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:14 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d" returned: 0 in 1.209s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Lock "cinder-quobyte-e5606c63-4b93-4980-80b7-0d34a7c91d26" released by "delete_volume" :: held 2.477s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:14 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d Jul 09 05:05:14 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:15 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Created reservations ['e5ff13f9-a3cd-4e35-bc24-80b2ca3e9996', '61731c2e-9528-4add-a980-a4f0e76e1574', '85f91c70-f21d-4e5d-8a38-51e07c053a14', 'cb66ecaf-4268-43f3-ac86-d43aa46eeb70'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:05:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:15 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:05:15 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:15 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d" returned: 0 in 0.830s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Lock "cinder-quobyte-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d" released by "delete_volume" :: held 2.088s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:15 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Created reservations ['73e4bdb2-91f3-4305-b32e-7a0e931a8725', '3b804514-175b-4185-914e-ce9698d41682', 'c6776244-81c9-4289-b872-1beff3f2292a', '1261c17d-dbb3-40ce-ac53-9958a60be099'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:05:16 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.839s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Deleted volume successfully. Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-74eee340-3190-4cc8-9abb-de079b307ab3 tempest-AbsoluteLimitsTests-1136192347 None] Lock "cinder-e5606c63-4b93-4980-80b7-0d34a7c91d26-delete_volume" released by "delete_volume" :: held 3.788s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:16 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:05:16 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Flow 'volume_create_manager' (a0303990-3bcd-4fd2-aecf-1db72c8e8573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cad612-8a65-4509-ac45-aa1feea0e801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cad612-8a65-4509-ac45-aa1feea0e801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-833703244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b43eec-3b15-4e58-928d-0dae6c597d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e5e1418cf44e0b4f199acd6745a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:17Z,use_quota=True,user_id='50dfa129e9274b2887a2be4268f084bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3315716-3252-4587-9bd3-c6d0904542e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3315716-3252-4587-9bd3-c6d0904542e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0588bb91-09bc-4a6d-801e-11e931b1c8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0588bb91-09bc-4a6d-801e-11e931b1c8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b43eec-3b15-4e58-928d-0dae6c597d46', 'volume_name': 'volume-52b43eec-3b15-4e58-928d-0dae6c597d46', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58350c9c-17fd-4629-a734-619e7c0d57e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58350c9c-17fd-4629-a734-619e7c0d57e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873b8315-7368-430c-94eb-b87badb42671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:17 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Volume 52b43eec-3b15-4e58-928d-0dae6c597d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b43eec-3b15-4e58-928d-0dae6c597d46', 'volume_size': 1} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-833703244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b43eec-3b15-4e58-928d-0dae6c597d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e5e1418cf44e0b4f199acd6745a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:17Z,use_quota=True,user_id='50dfa129e9274b2887a2be4268f084bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Creating volume 52b43eec-3b15-4e58-928d-0dae6c597d46 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:05:17 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:17 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46 1073741824 Jul 09 05:05:17 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:17 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.102s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:17 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Deleted volume successfully. Jul 09 05:05:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab268a74-c0c4-45af-918a-6e816c09e347 tempest-VolumesTransfersV355Test-2120542511 None] Lock "cinder-9f7af3d9-70ff-47ac-b6a8-79a0b7d26c6d-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:18 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46 1073741824" returned: 0 in 1.164s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:18 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46 Jul 09 05:05:18 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:19 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46" returned: 0 in 0.983s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:05:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873b8315-7368-430c-94eb-b87badb42671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b43eec-3b15-4e58-928d-0dae6c597d46', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3c3d56-c132-42f3-adf7-190429ac616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:19 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Volume volume-52b43eec-3b15-4e58-928d-0dae6c597d46 (52b43eec-3b15-4e58-928d-0dae6c597d46): created successfully Jul 09 05:05:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3c3d56-c132-42f3-adf7-190429ac616c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Flow 'volume_create_manager' (a0303990-3bcd-4fd2-aecf-1db72c8e8573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e0b7d8b4-b868-4288-b7f9-ab80d1175d09 tempest-VolumesTransfersV355Test-598921263 None] Created volume successfully. Jul 09 05:05:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Acquiring lock "cinder-52b43eec-3b15-4e58-928d-0dae6c597d46-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Lock "cinder-52b43eec-3b15-4e58-928d-0dae6c597d46-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Acquiring lock "cinder-quobyte-52b43eec-3b15-4e58-928d-0dae6c597d46" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Lock "cinder-quobyte-52b43eec-3b15-4e58-928d-0dae6c597d46" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:20 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3793ca4b-09d3-4c6d-afce-b8bc6dcf6287]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:21 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46 Jul 09 05:05:21 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:22 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46" returned: 0 in 1.191s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:22 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46 Jul 09 05:05:22 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:22 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52b43eec-3b15-4e58-928d-0dae6c597d46" returned: 0 in 0.820s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Lock "cinder-quobyte-52b43eec-3b15-4e58-928d-0dae6c597d46" released by "delete_volume" :: held 2.068s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:23 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Created reservations ['527b2443-2f0d-40e6-85da-4a0b40f2aa24', '08da7069-0b93-4846-a21e-9d38161eb116', 'cc76f810-1d7c-4e0a-8ebe-ccc25a1eae66', 'f98cb05a-0103-46e3-b442-00d53441ca97'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:05:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:23 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:05:23 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:23 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.799s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:23 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:23 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Deleted volume successfully. Jul 09 05:05:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-31eb90e9-4353-44cf-b87c-8680510812f1 tempest-VolumesTransfersV355Test-2120542511 None] Lock "cinder-52b43eec-3b15-4e58-928d-0dae6c597d46-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Flow 'volume_create_manager' (09592887-8348-49bc-9b5f-a4335c089128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e28ddcd-728d-4ef2-874d-9a1b1af890b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e28ddcd-728d-4ef2-874d-9a1b1af890b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-262541206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e0a59c-43a7-49b8-abcc-185c85107f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eadc27a4066475ca869ff9b42c7e4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:24Z,use_quota=True,user_id='44acdbec9bda453f80ed557837da73a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf3d679-25b1-477c-bd52-4b6bd870c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf3d679-25b1-477c-bd52-4b6bd870c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd6276a-0b91-4491-9b3e-8d2a8849394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd6276a-0b91-4491-9b3e-8d2a8849394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e0a59c-43a7-49b8-abcc-185c85107f4b', 'volume_name': 'volume-72e0a59c-43a7-49b8-abcc-185c85107f4b', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692756e9-e09c-48e1-9378-5f94332a2580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692756e9-e09c-48e1-9378-5f94332a2580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5057a75b-1063-44f1-8e42-1c401f8f080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:24 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Volume 72e0a59c-43a7-49b8-abcc-185c85107f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e0a59c-43a7-49b8-abcc-185c85107f4b', 'volume_size': 1} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-262541206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e0a59c-43a7-49b8-abcc-185c85107f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eadc27a4066475ca869ff9b42c7e4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:24Z,use_quota=True,user_id='44acdbec9bda453f80ed557837da73a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Creating volume 72e0a59c-43a7-49b8-abcc-185c85107f4b {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:05:24 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:05:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:24 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b 1073741824 Jul 09 05:05:24 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:25 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b 1073741824" returned: 0 in 1.147s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:25 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b Jul 09 05:05:25 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:26 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b" returned: 0 in 0.740s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:05:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5057a75b-1063-44f1-8e42-1c401f8f080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e0a59c-43a7-49b8-abcc-185c85107f4b', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c072cd76-12f2-41ca-9591-a6e45b463ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:26 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Volume volume-72e0a59c-43a7-49b8-abcc-185c85107f4b (72e0a59c-43a7-49b8-abcc-185c85107f4b): created successfully Jul 09 05:05:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c072cd76-12f2-41ca-9591-a6e45b463ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Flow 'volume_create_manager' (09592887-8348-49bc-9b5f-a4335c089128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:26 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-fb7e5196-c699-441a-b377-41f8ab1090ff tempest-VolumesTransfersV357Test-960521633 None] Created volume successfully. Jul 09 05:05:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9b944ebd-080b-4e88-8cce-19721a4c14bf tempest-VolumesTransfersV357Test-385089526 None] Transfer volume completed successfully. Jul 09 05:05:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Acquiring lock "cinder-72e0a59c-43a7-49b8-abcc-185c85107f4b-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Lock "cinder-72e0a59c-43a7-49b8-abcc-185c85107f4b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Acquiring lock "cinder-quobyte-72e0a59c-43a7-49b8-abcc-185c85107f4b" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Lock "cinder-quobyte-72e0a59c-43a7-49b8-abcc-185c85107f4b" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:29 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9091c2-7e7c-49d3-83ea-68c6378e4e81]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:29 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b Jul 09 05:05:29 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:30 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b" returned: 0 in 0.847s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:30 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b Jul 09 05:05:30 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:31 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-72e0a59c-43a7-49b8-abcc-185c85107f4b" returned: 0 in 0.728s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Lock "cinder-quobyte-72e0a59c-43a7-49b8-abcc-185c85107f4b" released by "delete_volume" :: held 1.631s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:31 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Created reservations ['3f1c1641-2950-4237-8e44-63a7913816f7', 'ea87adea-b963-4405-95a2-e1407b9066b2', '2e152a6e-1f11-4dc5-965a-3e4dadcdb51f', '6c151b66-49fa-4e01-bf8c-6b6860a3d39b'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:05:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:31 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:05:31 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:32 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.745s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:32 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Deleted volume successfully. Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf02bde9-90e2-4323-8955-ab2ecf3c3f8e tempest-VolumesTransfersV357Test-261088507 None] Lock "cinder-72e0a59c-43a7-49b8-abcc-185c85107f4b-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Flow 'volume_create_manager' (220aba93-dabd-4fe5-aac9-09b34f42fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6208b8e4-129d-44cc-a3f5-bacbb777d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6208b8e4-129d-44cc-a3f5-bacbb777d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-741844861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3ff187-284b-49be-b5d7-60bc36db01fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eadc27a4066475ca869ff9b42c7e4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:33Z,use_quota=True,user_id='44acdbec9bda453f80ed557837da73a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f8d34b-694f-4700-9f4e-631ca1e12f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f8d34b-694f-4700-9f4e-631ca1e12f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f4ba9f-c73e-4c2b-a219-f46f945b1ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f4ba9f-c73e-4c2b-a219-f46f945b1ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a3ff187-284b-49be-b5d7-60bc36db01fe', 'volume_name': 'volume-6a3ff187-284b-49be-b5d7-60bc36db01fe', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02722c8b-f2c8-48ee-a886-dd62595704df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02722c8b-f2c8-48ee-a886-dd62595704df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ca4b65-cd7d-424e-a40b-aa97fabcdea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:32 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Volume 6a3ff187-284b-49be-b5d7-60bc36db01fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a3ff187-284b-49be-b5d7-60bc36db01fe', 'volume_size': 1} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-741844861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3ff187-284b-49be-b5d7-60bc36db01fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eadc27a4066475ca869ff9b42c7e4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:33Z,use_quota=True,user_id='44acdbec9bda453f80ed557837da73a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Creating volume 6a3ff187-284b-49be-b5d7-60bc36db01fe {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:05:32 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:05:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:32 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe 1073741824 Jul 09 05:05:32 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:33 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe 1073741824" returned: 0 in 0.979s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:33 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe Jul 09 05:05:33 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:33 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:05:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Flow 'volume_create_manager' (d9fe0cc8-a294-4554-8542-597890f159e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aaa6cc0-0045-41f6-9005-a7810c868706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aaa6cc0-0045-41f6-9005-a7810c868706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-190171060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24596fd-a256-4089-9618-e9a0355af30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2561aac0bd4e82b8d22d9b8d5d7f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:34Z,use_quota=True,user_id='29f82cc0d56b4261983805091dcb959a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced38d69-6889-4633-b90c-d500fd303994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced38d69-6889-4633-b90c-d500fd303994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0031b65f-0bc5-4910-b1a1-5e6a331f9dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0031b65f-0bc5-4910-b1a1-5e6a331f9dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24596fd-a256-4089-9618-e9a0355af30d', 'volume_name': 'volume-a24596fd-a256-4089-9618-e9a0355af30d', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fe468a-3c6c-43b4-9ed3-9c4772590242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fe468a-3c6c-43b4-9ed3-9c4772590242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec69d836-621b-48d4-a9ac-82555fb58da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Volume a24596fd-a256-4089-9618-e9a0355af30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24596fd-a256-4089-9618-e9a0355af30d', 'volume_size': 1} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:34 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe" returned: 0 in 0.698s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-190171060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24596fd-a256-4089-9618-e9a0355af30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2561aac0bd4e82b8d22d9b8d5d7f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:34Z,use_quota=True,user_id='29f82cc0d56b4261983805091dcb959a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Creating volume a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:05:34 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ca4b65-cd7d-424e-a40b-aa97fabcdea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a3ff187-284b-49be-b5d7-60bc36db01fe', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8998f6d-87b7-4ea9-86bc-975ab4ceb72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:34 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d 1073741824 Jul 09 05:05:34 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Volume volume-6a3ff187-284b-49be-b5d7-60bc36db01fe (6a3ff187-284b-49be-b5d7-60bc36db01fe): created successfully Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8998f6d-87b7-4ea9-86bc-975ab4ceb72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Flow 'volume_create_manager' (220aba93-dabd-4fe5-aac9-09b34f42fc14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:34 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4e328e67-07f2-4dae-a711-ef6a89988c4d tempest-VolumesTransfersV357Test-960521633 None] Created volume successfully. Jul 09 05:05:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Acquiring lock "cinder-6a3ff187-284b-49be-b5d7-60bc36db01fe-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Lock "cinder-6a3ff187-284b-49be-b5d7-60bc36db01fe-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:35 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Acquiring lock "cinder-quobyte-6a3ff187-284b-49be-b5d7-60bc36db01fe" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d 1073741824" returned: 0 in 1.132s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Lock "cinder-quobyte-6a3ff187-284b-49be-b5d7-60bc36db01fe" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:35 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4eda07-453b-485c-b533-deb4ad52953f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:35 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d Jul 09 05:05:35 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:35 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe Jul 09 05:05:35 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:36 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d" returned: 0 in 0.727s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:05:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec69d836-621b-48d4-a9ac-82555fb58da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24596fd-a256-4089-9618-e9a0355af30d', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20308a58-139a-42df-8c96-4f0dba919316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:36 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Volume volume-a24596fd-a256-4089-9618-e9a0355af30d (a24596fd-a256-4089-9618-e9a0355af30d): created successfully Jul 09 05:05:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20308a58-139a-42df-8c96-4f0dba919316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Flow 'volume_create_manager' (d9fe0cc8-a294-4554-8542-597890f159e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:36 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-52d71dba-9644-44eb-bb29-b527e93a26ec tempest-VolumesSnapshotListTestJSON-1345673672 None] Created volume successfully. Jul 09 05:05:36 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe" returned: 0 in 0.944s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:36 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe Jul 09 05:05:36 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Creating offline snapshot 5d231631-e103-4dc5-a7ad-7d0cf8cd0300 of volume a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[492f6181-7728-47ca-8607-c174ec79912e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:37 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6a3ff187-284b-49be-b5d7-60bc36db01fe" returned: 0 in 0.982s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Lock "cinder-quobyte-6a3ff187-284b-49be-b5d7-60bc36db01fe" released by "delete_volume" :: held 1.975s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Created reservations ['58663385-1c27-4235-b715-f05212ea1b4c', 'ef3ab4fc-bd4c-43d6-8ad4-b2e6f92c235a', '65135fac-0292-44d6-812c-ce25dfea2ec5', '0e3cf725-aa4d-423f-845c-d27037d7d72a'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:05:37 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d Jul 09 05:05:37 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:37 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:05:37 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:38 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.952s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:38 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:38 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Deleted volume successfully. Jul 09 05:05:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34703526-9adf-437f-9ab0-c561f69152bc tempest-VolumesTransfersV357Test-261088507 None] Lock "cinder-6a3ff187-284b-49be-b5d7-60bc36db01fe-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:38 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d" returned: 0 in 1.332s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:38 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 1G Jul 09 05:05:38 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:39 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:05:39 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:39 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.822s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 8 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:05:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:05:40 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 1G" returned: 0 in 1.211s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24596fd-a256-4089-9618-e9a0355af30d -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:40 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24596fd-a256-4089-9618-e9a0355af30d -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 Jul 09 05:05:40 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:40 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24596fd-a256-4089-9618-e9a0355af30d -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300" returned: 0 in 0.885s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:40 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 is being set with open permissions: ugo+rw Jul 09 05:05:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:41 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 Jul 09 05:05:41 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:41 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300" returned: 0 in 0.744s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:41 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.info Jul 09 05:05:41 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:42 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.info" returned: 0 in 0.793s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:42 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.info is being set with open permissions: ugo+rw Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:42 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.info Jul 09 05:05:42 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Flow 'volume_create_manager' (67fd70b8-cb61-4a5f-bdc8-ba25a3329459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e1552e-85aa-4a9b-8394-e0d5e9a3ae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e1552e-85aa-4a9b-8394-e0d5e9a3ae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-513776074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d14610-8dfc-4fe5-a49e-5be4de6b1549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8882c4c6d9b04171b45cbc574752c631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:43Z,use_quota=True,user_id='7f5b5986b91e460185ddfc7360fe15ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0308b6-a520-4c75-80b9-722f2a2df462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0308b6-a520-4c75-80b9-722f2a2df462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314970ef-703f-4a31-b846-916546325627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314970ef-703f-4a31-b846-916546325627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d14610-8dfc-4fe5-a49e-5be4de6b1549', 'volume_name': 'volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a52436-536d-4cbc-816c-a5364f8f284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a52436-536d-4cbc-816c-a5364f8f284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c09a714-cc4e-4f9a-8847-7712e23e604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Volume 57d14610-8dfc-4fe5-a49e-5be4de6b1549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549', 'volume_size': 1} Jul 09 05:05:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:43 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.info" returned: 0 in 0.726s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.812s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-513776074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d14610-8dfc-4fe5-a49e-5be4de6b1549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8882c4c6d9b04171b45cbc574752c631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:43Z,use_quota=True,user_id='7f5b5986b91e460185ddfc7360fe15ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Creating volume 57d14610-8dfc-4fe5-a49e-5be4de6b1549 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:05:43 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:05:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:43 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549 1073741824 Jul 09 05:05:43 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:43 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-69fad382-ac80-41ff-aff8-4550b8d50296 tempest-VolumesSnapshotListTestJSON-1345673672 None] Create snapshot completed successfully Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:44 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549 1073741824" returned: 0 in 0.917s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:44 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549 Jul 09 05:05:44 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Flow 'volume_create_manager' (b8cb02a8-c150-415c-aa3c-c8fc06c05a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d0a3dd-1295-4290-b242-c33fc47d7a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:44 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549" returned: 0 in 0.706s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.948s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d0a3dd-1295-4290-b242-c33fc47d7a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-442367569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e745008c-b02e-4073-a252-6114d5455c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0ef5ae48fe4a97978be8f031a4d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:45Z,use_quota=True,user_id='a75dd764583c41b8b64017d82408aea8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1725e6-357a-42e3-8895-a6e3fd56cbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1725e6-357a-42e3-8895-a6e3fd56cbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed2448a-8bd6-4b10-99df-71f96d225628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed2448a-8bd6-4b10-99df-71f96d225628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e745008c-b02e-4073-a252-6114d5455c2a', 'volume_name': 'volume-e745008c-b02e-4073-a252-6114d5455c2a', 'volume_size': 2}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f3d69e-749b-4668-955c-a71e25c68758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f3d69e-749b-4668-955c-a71e25c68758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b459de-bce7-4cfd-b38a-2925d49157b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:45 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Volume e745008c-b02e-4073-a252-6114d5455c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e745008c-b02e-4073-a252-6114d5455c2a', 'volume_size': 2} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] Creating offline snapshot 360564a4-3bd6-4ace-a864-bda0b7b0fa5b of volume a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c09a714-cc4e-4f9a-8847-7712e23e604d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7eb82d9-fe92-4d7e-aab2-0a639dc378d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc6077-b7f6-4dd8-a857-8a2895f14b56]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:45 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Volume volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549 (57d14610-8dfc-4fe5-a49e-5be4de6b1549): created successfully Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7eb82d9-fe92-4d7e-aab2-0a639dc378d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Flow 'volume_create_manager' (67fd70b8-cb61-4a5f-bdc8-ba25a3329459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:45 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-2bf3e897-f27b-4d13-9e60-032c35c14dbd tempest-VolumeQuotasAdminTestJSON-1900589397 None] Created volume successfully. Jul 09 05:05:45 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 Jul 09 05:05:45 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Acquiring lock "cinder-57d14610-8dfc-4fe5-a49e-5be4de6b1549-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "cinder-57d14610-8dfc-4fe5-a49e-5be4de6b1549-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Acquiring lock "cinder-quobyte-57d14610-8dfc-4fe5-a49e-5be4de6b1549" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "cinder-quobyte-57d14610-8dfc-4fe5-a49e-5be4de6b1549" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b124f7-cbe0-44a7-9979-1370b3889325]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:45 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300" returned: 0 in 0.899s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24596fd-a256-4089-9618-e9a0355af30d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:05:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:46 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b 1G Jul 09 05:05:46 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:46 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549 Jul 09 05:05:46 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:46 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549" returned: 0 in 0.833s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:46 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549 Jul 09 05:05:46 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:46 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b 1G" returned: 0 in 0.901s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:46 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b Jul 09 05:05:46 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:47 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-57d14610-8dfc-4fe5-a49e-5be4de6b1549" returned: 0 in 0.692s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "cinder-quobyte-57d14610-8dfc-4fe5-a49e-5be4de6b1549" released by "delete_volume" :: held 1.575s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Created reservations ['ce92147a-86fc-488b-ab91-f299473e2ad8', '829d5252-613f-44a2-959b-5d486395e08b', '009a95af-7db8-443d-a88e-1050f64cf302', '2f81a1d7-d911-42a8-856b-264b9d9b9505'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:47 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b" returned: 0 in 0.773s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:47 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b is being set with open permissions: ugo+rw Jul 09 05:05:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:47 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:05:47 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:47 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b Jul 09 05:05:47 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:48 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b" returned: 0 in 0.724s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:48 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.524s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.472s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-442367569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e745008c-b02e-4073-a252-6114d5455c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0ef5ae48fe4a97978be8f031a4d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:45Z,use_quota=True,user_id='a75dd764583c41b8b64017d82408aea8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Creating volume e745008c-b02e-4073-a252-6114d5455c2a {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:05:48 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a 2147483648 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.867s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:48 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a 2147483648 Jul 09 05:05:48 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:48 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Deleted volume successfully. Jul 09 05:05:48 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-44f59f74-96d0-4a49-9486-5aafb9a01ae9 tempest-VolumesSnapshotListTestJSON-1345673672 None] Create snapshot completed successfully Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-87cff2ca-00ec-44de-9375-0a88a4140e93 tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "cinder-57d14610-8dfc-4fe5-a49e-5be4de6b1549-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Flow 'volume_create_manager' (62ddfc54-ade8-40da-a374-b4735a0491a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb311f8-4f83-4c9e-a41f-5d2c1bf4f7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb311f8-4f83-4c9e-a41f-5d2c1bf4f7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1717985049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513afbfb-26f7-4b73-84ce-54ded4717ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8882c4c6d9b04171b45cbc574752c631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:49Z,use_quota=True,user_id='7f5b5986b91e460185ddfc7360fe15ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7e2dd8-eb32-4e71-b273-24ac612f75e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7e2dd8-eb32-4e71-b273-24ac612f75e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6949b7be-c098-475b-ac09-62af2c169c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6949b7be-c098-475b-ac09-62af2c169c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513afbfb-26f7-4b73-84ce-54ded4717ce2', 'volume_name': 'volume-513afbfb-26f7-4b73-84ce-54ded4717ce2', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de869e0a-f61e-4d67-8afe-1ffbab788096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de869e0a-f61e-4d67-8afe-1ffbab788096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cedf1f5-37b9-4239-9605-54039f9b91e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:48 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Volume 513afbfb-26f7-4b73-84ce-54ded4717ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513afbfb-26f7-4b73-84ce-54ded4717ce2', 'volume_size': 1} Jul 09 05:05:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:49 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a 2147483648" returned: 0 in 1.021s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:49 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a Jul 09 05:05:49 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:50 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a" returned: 0 in 0.657s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1717985049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513afbfb-26f7-4b73-84ce-54ded4717ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8882c4c6d9b04171b45cbc574752c631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:49Z,use_quota=True,user_id='7f5b5986b91e460185ddfc7360fe15ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Creating volume 513afbfb-26f7-4b73-84ce-54ded4717ce2 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:05:50 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b459de-bce7-4cfd-b38a-2925d49157b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e745008c-b02e-4073-a252-6114d5455c2a', 'volume_size': 2}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:50 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2 1073741824 Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0302d1fb-5ad2-422a-8f83-404b4df06c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:50 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:50 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Volume volume-e745008c-b02e-4073-a252-6114d5455c2a (e745008c-b02e-4073-a252-6114d5455c2a): created successfully Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0302d1fb-5ad2-422a-8f83-404b4df06c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Flow 'volume_create_manager' (b8cb02a8-c150-415c-aa3c-c8fc06c05a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:50 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7ba4012a-ec56-4640-8102-db1ebd7b9e95 tempest-VolumesCloneNegativeTest-2050859506 None] Created volume successfully. Jul 09 05:05:51 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2 1073741824" returned: 0 in 0.804s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=100,cinder:INSERT=25,cinder:UPDATE=116,cinder:DELETE=9 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=89,cinder:INSERT=34,cinder:UPDATE=137,cinder:DELETE=11 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:51 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2 Jul 09 05:05:51 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Acquiring lock "cinder-e745008c-b02e-4073-a252-6114d5455c2a-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Lock "cinder-e745008c-b02e-4073-a252-6114d5455c2a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Acquiring lock "cinder-quobyte-e745008c-b02e-4073-a252-6114d5455c2a" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Lock "cinder-quobyte-e745008c-b02e-4073-a252-6114d5455c2a" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[43df26f3-8a16-4f7f-9c56-98b4c64cfb01]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:51 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a Jul 09 05:05:51 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:51 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2" returned: 0 in 0.628s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.253s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cedf1f5-37b9-4239-9605-54039f9b91e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513afbfb-26f7-4b73-84ce-54ded4717ce2', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb79e6b-6945-433f-855f-60d780a9cd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] Creating offline snapshot 2dc1a88d-d253-4a93-a088-aacb7e22ad61 of volume a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:05:51 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Volume volume-513afbfb-26f7-4b73-84ce-54ded4717ce2 (513afbfb-26f7-4b73-84ce-54ded4717ce2): created successfully Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb79e6b-6945-433f-855f-60d780a9cd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Flow 'volume_create_manager' (62ddfc54-ade8-40da-a374-b4735a0491a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[935e07b1-00e8-436b-8fe2-227de6f88ecc]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f85ad372-1c71-4ac7-9fd7-6ce7c7e6ec3b tempest-VolumeQuotasAdminTestJSON-1900589397 None] Created volume successfully. Jul 09 05:05:51 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b Jul 09 05:05:51 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:52 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a" returned: 0 in 0.773s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:52 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a Jul 09 05:05:52 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:52 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24596fd-a256-4089-9618-e9a0355af30d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:05:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:52 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 1G Jul 09 05:05:52 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:53 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e745008c-b02e-4073-a252-6114d5455c2a" returned: 0 in 0.694s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Lock "cinder-quobyte-e745008c-b02e-4073-a252-6114d5455c2a" released by "delete_volume" :: held 1.520s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Created reservations ['58416f09-d518-4bf7-a4ed-26739dac76a6', '330374a7-a04f-44f2-9e21-38692095b261', 'bcb66408-7cdf-43f8-a3e0-84430e3fd4bf', '8064aef7-698c-42ad-8d9b-acb6fc7cda99'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:53 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:05:53 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:53 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 1G" returned: 0 in 1.097s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:53 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 Jul 09 05:05:53 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:53 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1af5df50-5070-473e-923b-ed669de2b742 tempest-VolumeQuotasAdminTestJSON-408919860 None] Transfer volume completed successfully. Jul 09 05:05:54 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.968s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:54 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Deleted volume successfully. Jul 09 05:05:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c77afa7-f17f-41ba-9e58-26af1961fc5b tempest-VolumesCloneNegativeTest-2050859506 None] Lock "cinder-e745008c-b02e-4073-a252-6114d5455c2a-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:54 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61" returned: 0 in 1.206s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:54 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 is being set with open permissions: ugo+rw Jul 09 05:05:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:54 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 Jul 09 05:05:54 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Acquiring lock "cinder-513afbfb-26f7-4b73-84ce-54ded4717ce2-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Lock "cinder-513afbfb-26f7-4b73-84ce-54ded4717ce2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Acquiring lock "cinder-quobyte-513afbfb-26f7-4b73-84ce-54ded4717ce2" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Lock "cinder-quobyte-513afbfb-26f7-4b73-84ce-54ded4717ce2" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:55 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f78687-574c-4bac-b956-2325eb4ee01f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:55 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2 Jul 09 05:05:55 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:55 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61" returned: 0 in 0.952s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.232s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ba0fd878-5270-4a40-8b75-ba628cd528d6 tempest-VolumesSnapshotListTestJSON-1345673672 None] Create snapshot completed successfully Jul 09 05:05:56 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2" returned: 0 in 1.117s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:56 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2 Jul 09 05:05:56 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:56 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-513afbfb-26f7-4b73-84ce-54ded4717ce2" returned: 0 in 0.704s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Lock "cinder-quobyte-513afbfb-26f7-4b73-84ce-54ded4717ce2" released by "delete_volume" :: held 1.887s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Created reservations ['7000fe65-7378-476f-b6b4-68b22112f26d', '84455470-0e38-4a7f-bda0-868893b5e053', '567b2e9b-fb0f-4caa-a14d-67f483e0ca0a', 'd9c8591b-bb1c-4d0b-8fef-88b993c17248'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:57 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:05:57 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:57 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.747s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:05:57 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Deleted volume successfully. Jul 09 05:05:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4aad0896-2d71-48e5-8d13-2aa830ce913a tempest-VolumeQuotasAdminTestJSON-1319704215 None] Lock "cinder-513afbfb-26f7-4b73-84ce-54ded4717ce2-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-2dc1a88d-d253-4a93-a088-aacb7e22ad61-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-2dc1a88d-d253-4a93-a088-aacb7e22ad61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Flow 'volume_create_manager' (09f957b4-68f3-4b6b-9113-048b3b0f8a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d8c08b-9b06-49ec-b509-689f1e961d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-quobyte-2dc1a88d-d253-4a93-a088-aacb7e22ad61" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d8c08b-9b06-49ec-b509-689f1e961d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1323387322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa359aa-9ddf-452e-8439-4c1f0622bd28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='accef0fd1aae4f79a90bb3eafc31b02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:58Z,use_quota=True,user_id='2a0a14d365de4853b572a6394a543c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363a0601-2d12-43a9-862c-c3a0aa9512ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363a0601-2d12-43a9-862c-c3a0aa9512ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4711a9-f7b8-45d1-be7b-b0b177f66192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.image.glance [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Creating Keystone auth plugin from conf {{(pid=87161) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-2dc1a88d-d253-4a93-a088-aacb7e22ad61" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Deleting offline snapshot 2dc1a88d-d253-4a93-a088-aacb7e22ad61 of volume a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] snapshot_file for this snap is: volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6673388b-6133-449e-b964-38580461639b]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:58 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 Jul 09 05:05:58 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:59 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Jul 09 05:05:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61" returned: 0 in 0.870s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:05:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24596fd-a256-4089-9618-e9a0355af30d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:05:59 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd02f74-5b82-4145-ab7f-50b9943ec230]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:05:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:05:59 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b Jul 09 05:05:59 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:05:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4711a9-f7b8-45d1-be7b-b0b177f66192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fa359aa-9ddf-452e-8439-4c1f0622bd28', 'volume_name': 'volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fd6e60-3308-4bed-af74-8dbc75312d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fd6e60-3308-4bed-af74-8dbc75312d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:05:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7cd37d-0397-4fde-ae33-eb4cc18885df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:05:59 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Volume 3fa359aa-9ddf-452e-8439-4c1f0622bd28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 05:05:59 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Trying to clone 3fa359aa-9ddf-452e-8439-4c1f0622bd28 from image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]). {{(pid=87161) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 05:06:00 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 05:06:00 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Image download 20.69 MB at 20.69 MB/s Jul 09 05:06:00 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c419414e-6b10-4de0-92a9-10d47df1b170]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:00 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD Jul 09 05:06:00 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:00 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b" returned: 0 in 1.316s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24596fd-a256-4089-9618-e9a0355af30d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:06:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:00 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 Jul 09 05:06:00 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:01 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD" returned: 0 in 1.116s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:01 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Temporary image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 is fetched for user 2a0a14d365de4853b572a6394a543c14. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 05:06:01 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[24981aa1-c311-4ff0-97f4-7ca6dc44d6bc]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:01 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD Jul 09 05:06:01 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:01 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61" returned: 0 in 1.075s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:01 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61 Jul 09 05:06:01 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:02 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD" returned: 0 in 0.968s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1323387322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa359aa-9ddf-452e-8439-4c1f0622bd28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='accef0fd1aae4f79a90bb3eafc31b02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:05:58Z,use_quota=True,user_id='2a0a14d365de4853b572a6394a543c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Creating volume 3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:06:02 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:02 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 1073741824 Jul 09 05:06:02 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:02 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.2dc1a88d-d253-4a93-a088-aacb7e22ad61" returned: 0 in 0.893s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-2dc1a88d-d253-4a93-a088-aacb7e22ad61" released by "_delete_snapshot" :: held 4.271s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" released by "delete_snapshot" :: held 4.348s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Created reservations ['d082b3c0-c183-4ac4-bdce-6e3d2eafa253', 'fe5d5317-c6b2-491e-8087-eff27c3e3319', 'ce1f999f-31c5-44d4-b304-f215fc0550e7', 'ce873eee-2c7a-42f4-81d7-2de641cd5a81'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:02 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Delete snapshot completed successfully. Jul 09 05:06:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8dfd6866-e5b7-4487-a486-d9340ce74360 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-2dc1a88d-d253-4a93-a088-aacb7e22ad61-delete_snapshot" released by "delete_snapshot" :: held 4.665s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-360564a4-3bd6-4ace-a864-bda0b7b0fa5b-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:03 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 1073741824" returned: 0 in 1.234s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-360564a4-3bd6-4ace-a864-bda0b7b0fa5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-quobyte-360564a4-3bd6-4ace-a864-bda0b7b0fa5b" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-360564a4-3bd6-4ace-a864-bda0b7b0fa5b" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Deleting offline snapshot 360564a4-3bd6-4ace-a864-bda0b7b0fa5b of volume a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:06:03 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 Jul 09 05:06:03 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] snapshot_file for this snap is: volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4b3b46-cb4c-4e6c-8458-42f6bd20e060]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:04 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b Jul 09 05:06:04 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:04 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28" returned: 0 in 0.807s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:06:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:04 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Attempting download of dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}])) to volume 3fa359aa-9ddf-452e-8439-4c1f0622bd28. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 05:06:04 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c12cae2-9e2a-4b92-8c40-6ea32b31d785]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_2oiqrsvn {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:04 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_2oiqrsvn Jul 09 05:06:04 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:05 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b" returned: 0 in 1.388s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24596fd-a256-4089-9618-e9a0355af30d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:06:05 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3832203-72ec-42c3-8f6a-04cecf3dfbcc]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:05 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 Jul 09 05:06:05 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:05 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_2oiqrsvn" returned: 0 in 1.075s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_2oiqrsvn {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:05 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_2oiqrsvn Jul 09 05:06:05 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:06 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300" returned: 0 in 1.412s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24596fd-a256-4089-9618-e9a0355af30d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:06:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:06 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_2oiqrsvn" returned: 1 in 0.974s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_2oiqrsvn' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:06:06 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad8e74f-60db-4ff6-98fb-be564b01271d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:06 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b Jul 09 05:06:06 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:06 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD Jul 09 05:06:06 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:07 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b" returned: 0 in 0.929s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:07 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b Jul 09 05:06:07 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:07 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD" returned: 0 in 1.100s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:07 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 was qcow2, converting to raw {{(pid=87161) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 05:06:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:07 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 Jul 09 05:06:07 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:08 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.360564a4-3bd6-4ace-a864-bda0b7b0fa5b" returned: 0 in 1.121s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-360564a4-3bd6-4ace-a864-bda0b7b0fa5b" released by "_delete_snapshot" :: held 5.051s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" released by "delete_snapshot" :: held 5.106s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:08 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Created reservations ['06bf9fc5-db61-4c69-9405-f2fe76c0ab77', '40fb2db8-2991-4b1a-a364-7842b368a839', 'af1106b2-1019-4604-8fe7-035608dbdd05', '536726a5-ef11-4040-a929-b1e35876f984'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Delete snapshot completed successfully. Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Flow 'volume_create_manager' (2fed2d2f-3e43-4d30-868b-1e276119a181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf042f5-9eb1-4656-8c60-00b43a1f199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5e4fcea5-23c9-4719-9c24-0aeab93e1b02 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-360564a4-3bd6-4ace-a864-bda0b7b0fa5b-delete_snapshot" released by "delete_snapshot" :: held 5.431s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf042f5-9eb1-4656-8c60-00b43a1f199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1349008843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfd96c2-5257-43de-9a51-5a6ac7cedddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd0850159424590a16b2b726c99a050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:09Z,use_quota=True,user_id='1b1c58ce95c9481aa74e5cf6807daafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa01882-0f94-4345-8973-607b5d5c7ff1),volume_type_id=5aa01882-0f94-4345-8973-607b5d5c7ff1)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e81aeb-853c-4664-94a1-375d29ffd4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e81aeb-853c-4664-94a1-375d29ffd4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10a7774-bf5f-425d-9320-bb148a239425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10a7774-bf5f-425d-9320-bb148a239425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfd96c2-5257-43de-9a51-5a6ac7cedddd', 'volume_name': 'volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9223f8b-2bf6-42db-abc6-c7e8fd37cdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9223f8b-2bf6-42db-abc6-c7e8fd37cdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41909a29-4d4c-4cc6-88e2-30f485d6dad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:09 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Volume 2cfd96c2-5257-43de-9a51-5a6ac7cedddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd', 'volume_size': 1} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1349008843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfd96c2-5257-43de-9a51-5a6ac7cedddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd0850159424590a16b2b726c99a050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:09Z,use_quota=True,user_id='1b1c58ce95c9481aa74e5cf6807daafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa01882-0f94-4345-8973-607b5d5c7ff1),volume_type_id=5aa01882-0f94-4345-8973-607b5d5c7ff1)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Creating volume 2cfd96c2-5257-43de-9a51-5a6ac7cedddd {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:06:09 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-5d231631-e103-4dc5-a7ad-7d0cf8cd0300-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:09 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd 1073741824 Jul 09 05:06:09 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-5d231631-e103-4dc5-a7ad-7d0cf8cd0300-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-quobyte-5d231631-e103-4dc5-a7ad-7d0cf8cd0300" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-5d231631-e103-4dc5-a7ad-7d0cf8cd0300" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Deleting offline snapshot 5d231631-e103-4dc5-a7ad-7d0cf8cd0300 of volume a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] snapshot_file for this snap is: volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[872055bf-cf48-43a3-97e4-eea3c18a776e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:09 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 Jul 09 05:06:09 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:10 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300" returned: 0 in 0.821s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24596fd-a256-4089-9618-e9a0355af30d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:06:10 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd 1073741824" returned: 0 in 0.982s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[91504d1b-7697-4dfa-9523-b3583a86600d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:10 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28" returned: 0 in 2.411s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_gfg0ew_cdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:06:10 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Converted 112.00 MB image at 46.44 MB/s Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:10 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 1G Jul 09 05:06:10 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:10 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd Jul 09 05:06:10 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:10 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d Jul 09 05:06:10 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:10 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd" returned: 0 in 0.735s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:06:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41909a29-4d4c-4cc6-88e2-30f485d6dad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fa65d0-2a2e-4a6d-b804-d4ce818a6f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Volume volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd (2cfd96c2-5257-43de-9a51-5a6ac7cedddd): created successfully Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fa65d0-2a2e-4a6d-b804-d4ce818a6f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Flow 'volume_create_manager' (2fed2d2f-3e43-4d30-868b-1e276119a181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f72f701e-48cd-41c7-bff8-3cb7a747da07 tempest-VolumeTypesAccessTest-1865481672 None] Created volume successfully. Jul 09 05:06:11 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d" returned: 0 in 0.947s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:11 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 Jul 09 05:06:11 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:11 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 1G" returned: 0 in 0.993s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[03727504-b017-4764-aaf2-35eeed3e3d07]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:11 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 Jul 09 05:06:11 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:11 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300" returned: 0 in 0.738s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:11 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300 Jul 09 05:06:11 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:12 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28" returned: 0 in 0.797s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:12 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 Jul 09 05:06:12 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Acquiring lock "cinder-2cfd96c2-5257-43de-9a51-5a6ac7cedddd-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Lock "cinder-2cfd96c2-5257-43de-9a51-5a6ac7cedddd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Acquiring lock "cinder-quobyte-2cfd96c2-5257-43de-9a51-5a6ac7cedddd" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Lock "cinder-quobyte-2cfd96c2-5257-43de-9a51-5a6ac7cedddd" acquired by "delete_volume" :: waited 0.040s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ad373c-6e56-4164-b9be-9c473d8a4185]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:12 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d.5d231631-e103-4dc5-a7ad-7d0cf8cd0300" returned: 0 in 0.737s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-5d231631-e103-4dc5-a7ad-7d0cf8cd0300" released by "_delete_snapshot" :: held 3.384s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" released by "delete_snapshot" :: held 3.410s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:12 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd Jul 09 05:06:12 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Created reservations ['bcba7d13-e25c-49c9-9209-077f2e3e6036', '0c9db173-7a47-4acf-829c-d47625805634', '968237ff-a08a-41ac-8b4d-7d23d2e3a8b2', 'c0027bb7-ad20-4b0f-b371-ef0733d252fb'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:12 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Delete snapshot completed successfully. Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a22ed968-24da-44b2-b112-753d4b6735d4 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-5d231631-e103-4dc5-a7ad-7d0cf8cd0300-delete_snapshot" released by "delete_snapshot" :: held 3.594s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:12 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28" returned: 1 in 0.893s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Downloaded image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}])) to volume 3fa359aa-9ddf-452e-8439-4c1f0622bd28 successfully. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Temporary image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 for user 2a0a14d365de4853b572a6394a543c14 is deleted. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Marking volume 3fa359aa-9ddf-452e-8439-4c1f0622bd28 as bootable. {{(pid=87161) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Copying metadata from image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 to 3fa359aa-9ddf-452e-8439-4c1f0622bd28. {{(pid=87161) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 05:06:12 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Creating volume glance metadata for volume 3fa359aa-9ddf-452e-8439-4c1f0622bd28 backed by image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87161) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7cd37d-0397-4fde-ae33-eb4cc18885df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0de6ba-5732-4318-8591-f94961bad220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:13 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Volume volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 (3fa359aa-9ddf-452e-8439-4c1f0622bd28): created successfully Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0de6ba-5732-4318-8591-f94961bad220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Flow 'volume_create_manager' (09f957b4-68f3-4b6b-9113-048b3b0f8a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b2b7e941-be64-4c22-bfec-df25949071dc tempest-VolumesExtendTest-132858217 None] Created volume successfully. Jul 09 05:06:13 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd" returned: 0 in 0.841s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:13 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd Jul 09 05:06:13 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-a24596fd-a256-4089-9618-e9a0355af30d-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-a24596fd-a256-4089-9618-e9a0355af30d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" acquired by "delete_volume" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfdc14e-9f1a-4f28-9628-c4939cdd4b44]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:13 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d Jul 09 05:06:13 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b374666-e641-46a3-bd1d-017326286263]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:14 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 Jul 09 05:06:14 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:14 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2cfd96c2-5257-43de-9a51-5a6ac7cedddd" returned: 0 in 0.883s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Lock "cinder-quobyte-2cfd96c2-5257-43de-9a51-5a6ac7cedddd" released by "delete_volume" :: held 1.777s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:14 devstack cinder-volume[87161]: WARNING cinder.quota [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-789909205 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-789909205, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:06:14 devstack cinder-volume[87161]: WARNING cinder.quota [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-789909205 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-789909205, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Created reservations ['df996bb0-c236-486a-bfe8-a3383b6c5d32', '32b21ea7-7400-4282-ad60-887d30e0c1e0', 'd37aea8c-55dc-4c13-948d-db2024537daf', 'db6de03a-c305-4cc8-b10c-c318bdde4bf5'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:14 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:06:14 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:14 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d" returned: 0 in 0.909s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:14 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d Jul 09 05:06:14 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:15 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28" returned: 0 in 1.299s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:15 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.973s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:06:15 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 Jul 09 05:06:15 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:15 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Deleted volume successfully. Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-669f3ea1-fed2-4136-ac3d-108b1de08bd5 tempest-VolumeTypesAccessTest-1865481672 None] Lock "cinder-2cfd96c2-5257-43de-9a51-5a6ac7cedddd-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:15 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a24596fd-a256-4089-9618-e9a0355af30d" returned: 0 in 1.187s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-quobyte-a24596fd-a256-4089-9618-e9a0355af30d" released by "delete_volume" :: held 2.201s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Created reservations ['ee709c21-00a6-4ef9-b92d-4142d0c28bcd', 'f625ff9f-f5e8-4496-8ae4-72ac7e269cee', '7e0e1680-ce41-45cb-b3f3-02c712d0d1af', 'e74fff10-36d2-43ad-9e69-5c5320096059'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:15 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:06:15 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:16 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28" returned: 1 in 1.080s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:06:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 2G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 2G" returned: 0 in 0.075s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.519s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-86114164-77fc-4f19-b061-6d37ea2bbc57 tempest-VolumesExtendTest-132858217 None] Extend volume completed successfully. Jul 09 05:06:16 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.721s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:16 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:06:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Deleted volume successfully. Jul 09 05:06:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2106e349-a47e-428d-a555-663e5198d036 tempest-VolumesSnapshotListTestJSON-1345673672 None] Lock "cinder-a24596fd-a256-4089-9618-e9a0355af30d-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Acquiring lock "cinder-3fa359aa-9ddf-452e-8439-4c1f0622bd28-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Lock "cinder-3fa359aa-9ddf-452e-8439-4c1f0622bd28-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Acquiring lock "cinder-quobyte-3fa359aa-9ddf-452e-8439-4c1f0622bd28" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Lock "cinder-quobyte-3fa359aa-9ddf-452e-8439-4c1f0622bd28" acquired by "delete_volume" :: waited 0.036s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:17 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc830ec-735c-415e-a9cb-e7f02bfe36ea]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:17 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 Jul 09 05:06:17 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:18 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28" returned: 0 in 0.941s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:18 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 Jul 09 05:06:18 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:19 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28" returned: 1 in 0.873s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:06:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:19 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28 Jul 09 05:06:19 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:20 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3fa359aa-9ddf-452e-8439-4c1f0622bd28" returned: 0 in 0.749s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Lock "cinder-quobyte-3fa359aa-9ddf-452e-8439-4c1f0622bd28" released by "delete_volume" :: held 2.661s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Created reservations ['141d74c4-d70a-4503-a6cc-db7efd4e74e0', 'cca0077c-187a-481f-bf5d-81b7d0e40860', '45dfae5c-d9a9-4cab-966e-7fdc9877a072', '59e68a37-5cba-4f1f-b5ad-5e18ed3fa5e9'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:20 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:06:20 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Flow 'volume_create_manager' (b831eedd-ccee-40ec-93ae-731251c98146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e363136-ddeb-49a4-93c1-de0f9f704272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e363136-ddeb-49a4-93c1-de0f9f704272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-164287124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565aabe8-4574-48db-aed4-07944141e342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f27437579e54c50857d49213612092c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:20Z,use_quota=True,user_id='9db16f02ad934a149a35789c828a192b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f95419d-1924-4d5c-ab50-be225aa9968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f95419d-1924-4d5c-ab50-be225aa9968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f30ca22-0197-484f-9910-4ac2547ef6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f30ca22-0197-484f-9910-4ac2547ef6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '565aabe8-4574-48db-aed4-07944141e342', 'volume_name': 'volume-565aabe8-4574-48db-aed4-07944141e342', 'volume_size': 2}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12ac90e-602e-4cad-b932-be1f3910948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12ac90e-602e-4cad-b932-be1f3910948e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d38f6d-c22b-430b-9181-582e80157d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:20 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Volume 565aabe8-4574-48db-aed4-07944141e342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-565aabe8-4574-48db-aed4-07944141e342', 'volume_size': 2} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-164287124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565aabe8-4574-48db-aed4-07944141e342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f27437579e54c50857d49213612092c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:20Z,use_quota=True,user_id='9db16f02ad934a149a35789c828a192b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Creating volume 565aabe8-4574-48db-aed4-07944141e342 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:06:20 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:06:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 2147483648 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:20 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 2147483648 Jul 09 05:06:20 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:21 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.702s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:06:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Deleted volume successfully. Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b3f03d9-cdaf-417f-ab06-23da3fd36f51 tempest-VolumesExtendTest-132858217 None] Lock "cinder-3fa359aa-9ddf-452e-8439-4c1f0622bd28-delete_volume" released by "delete_volume" :: held 3.652s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Flow 'volume_create_manager' (aa305b60-c84a-4383-921f-3156ccf47890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ea4eb0-cbe8-438a-982d-cd2b663dee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ea4eb0-cbe8-438a-982d-cd2b663dee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1801215322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='accef0fd1aae4f79a90bb3eafc31b02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:21Z,use_quota=True,user_id='2a0a14d365de4853b572a6394a543c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c4193a-a444-4ee0-887d-7680d08104aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c4193a-a444-4ee0-887d-7680d08104aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bcaeb6-0c19-445f-9214-94e1db0af12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bcaeb6-0c19-445f-9214-94e1db0af12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea', 'volume_name': 'volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2799b080-d15d-4984-a03b-05b73583be77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2799b080-d15d-4984-a03b-05b73583be77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7856c61b-71c6-4792-b7c3-0b1d359bc7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:21 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Volume 8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea', 'volume_size': 1} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:21 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 2147483648" returned: 0 in 1.023s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:21 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 Jul 09 05:06:21 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:22 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342" returned: 0 in 0.669s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.913s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1801215322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='accef0fd1aae4f79a90bb3eafc31b02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:21Z,use_quota=True,user_id='2a0a14d365de4853b572a6394a543c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Creating volume 8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:06:22 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d38f6d-c22b-430b-9181-582e80157d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-565aabe8-4574-48db-aed4-07944141e342', 'volume_size': 2}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:22 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea 1073741824 Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde46d92-a2c5-486f-bd72-f9c9e12aed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:22 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:22 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Volume volume-565aabe8-4574-48db-aed4-07944141e342 (565aabe8-4574-48db-aed4-07944141e342): created successfully Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde46d92-a2c5-486f-bd72-f9c9e12aed95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Flow 'volume_create_manager' (b831eedd-ccee-40ec-93ae-731251c98146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:22 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e115ef63-ea61-48b8-99a2-5948794567d1 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Created volume successfully. Jul 09 05:06:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:23 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea 1073741824" returned: 0 in 1.024s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:23 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea Jul 09 05:06:23 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:24 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" returned: 0 in 0.710s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.250s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7856c61b-71c6-4792-b7c3-0b1d359bc7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b264371-8291-4000-bfdd-c0023d346982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Creating offline snapshot e9d36e51-52b4-40ba-9808-3ce0bb2dacdf of volume 565aabe8-4574-48db-aed4-07944141e342 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:06:24 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Volume volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea (8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea): created successfully Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b264371-8291-4000-bfdd-c0023d346982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Flow 'volume_create_manager' (aa305b60-c84a-4383-921f-3156ccf47890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc95bf5d-06a5-452d-9cee-13ea25b9f0d7]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:24 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ef3b18f5-e247-4682-bbaf-0811db0fe770 tempest-VolumesExtendTest-132858217 None] Created volume successfully. Jul 09 05:06:24 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 Jul 09 05:06:24 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:25 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342" returned: 0 in 0.902s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf 2G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:25 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf 2G Jul 09 05:06:25 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:25 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf 2G" returned: 0 in 0.831s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565aabe8-4574-48db-aed4-07944141e342 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:25 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565aabe8-4574-48db-aed4-07944141e342 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf Jul 09 05:06:25 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:26 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565aabe8-4574-48db-aed4-07944141e342 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf" returned: 0 in 0.684s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:26 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf is being set with open permissions: ugo+rw Jul 09 05:06:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:26 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf Jul 09 05:06:26 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:26 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Flow 'volume_create_manager' (2bfd11cc-0ff8-401b-8169-076b922e9c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe08908-f7e2-4fc6-ae61-ffd4d6c7f8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe08908-f7e2-4fc6-ae61-ffd4d6c7f8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1115282973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698d335f-1a25-4bd7-8697-c3f19edc2246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c741f7f89dd4e46a51d3dc2faba2458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:27Z,use_quota=True,user_id='d82ceafb2881434387424500547c5932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4006a4-4628-4e08-9cd4-560109efd57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4006a4-4628-4e08-9cd4-560109efd57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23294637-309a-48b2-9971-b008463936ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.image.glance [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Creating Keystone auth plugin from conf {{(pid=87161) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 05:06:27 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf" returned: 0 in 0.718s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23294637-309a-48b2-9971-b008463936ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '698d335f-1a25-4bd7-8697-c3f19edc2246', 'volume_name': 'volume-698d335f-1a25-4bd7-8697-c3f19edc2246', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926f980e-9598-49f8-8f42-98f8d73b612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926f980e-9598-49f8-8f42-98f8d73b612e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f271c01d-86e4-470f-9bcd-ac0249b57e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:27 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Volume 698d335f-1a25-4bd7-8697-c3f19edc2246: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-698d335f-1a25-4bd7-8697-c3f19edc2246', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Trying to clone 698d335f-1a25-4bd7-8697-c3f19edc2246 from image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]). {{(pid=87161) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:27 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.info Jul 09 05:06:27 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Flow 'volume_create_manager' (509e9d27-7667-4c8b-99fa-bf5957b9b0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058a7301-c829-4508-adec-5556dad66829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058a7301-c829-4508-adec-5556dad66829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-537371402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36f2dba-fb38-473f-8c8c-627a616d60e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ced0737b67c4ea387b9881a69008da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:27Z,use_quota=True,user_id='6ef8fae360d746e8bbea63bec52c68a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a95c779-43d7-4344-bb81-71b794f3cb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a95c779-43d7-4344-bb81-71b794f3cb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c4fe36-a1a5-4345-b0fe-9b1c66a21822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c4fe36-a1a5-4345-b0fe-9b1c66a21822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36f2dba-fb38-473f-8c8c-627a616d60e5', 'volume_name': 'volume-e36f2dba-fb38-473f-8c8c-627a616d60e5', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd8bd20-7e37-449a-8b96-5994c3f32f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd8bd20-7e37-449a-8b96-5994c3f32f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676b16ca-194f-4fb4-9e80-690eda6922bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:27 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Volume e36f2dba-fb38-473f-8c8c-627a616d60e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36f2dba-fb38-473f-8c8c-627a616d60e5', 'volume_size': 1} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 05:06:27 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Image download 20.69 MB at 20.69 MB/s Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4f61b-4f1d-4e49-b570-d72853eeb0df]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:27 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD Jul 09 05:06:27 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:28 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.info" returned: 0 in 0.697s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:28 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.info is being set with open permissions: ugo+rw Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:28 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.info Jul 09 05:06:28 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:28 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Temporary image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 is fetched for user d82ceafb2881434387424500547c5932. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cb486f-f95c-415e-9349-1040f393e9d5]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:28 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD Jul 09 05:06:28 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:28 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.info" returned: 0 in 0.670s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.663s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.064s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Creating offline snapshot 35c44b32-c9bc-43b3-bfc4-a65cac960e20 of volume 8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:06:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5fa9959e-7d26-4319-a21e-43ae41e045ce tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Create snapshot completed successfully Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a830fe00-eb2d-4c53-b76b-40ec113ddb18]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:28 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea Jul 09 05:06:28 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Acquiring lock "cinder-e9d36e51-52b4-40ba-9808-3ce0bb2dacdf-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "cinder-e9d36e51-52b4-40ba-9808-3ce0bb2dacdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Acquiring lock "cinder-quobyte-565aabe8-4574-48db-aed4-07944141e342" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "cinder-quobyte-565aabe8-4574-48db-aed4-07944141e342" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Acquiring lock "cinder-quobyte-e9d36e51-52b4-40ba-9808-3ce0bb2dacdf" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "cinder-quobyte-e9d36e51-52b4-40ba-9808-3ce0bb2dacdf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Deleting offline snapshot e9d36e51-52b4-40ba-9808-3ce0bb2dacdf of volume 565aabe8-4574-48db-aed4-07944141e342 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] snapshot_file for this snap is: volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7380ad-202c-4c0d-97d8-c1883da04ab7]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:29 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:29 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf Jul 09 05:06:29 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:29 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" returned: 0 in 0.780s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:29 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 1G Jul 09 05:06:29 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:30 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf" returned: 0 in 0.791s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565aabe8-4574-48db-aed4-07944141e342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:06:30 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed44b72b-d5dc-425e-892b-a4b31a3bc042]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:30 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 Jul 09 05:06:30 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:30 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 1G" returned: 0 in 0.817s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:30 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 Jul 09 05:06:30 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:30 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342" returned: 0 in 0.745s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:30 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf Jul 09 05:06:30 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:31 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20" returned: 0 in 0.711s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:31 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 is being set with open permissions: ugo+rw Jul 09 05:06:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:31 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 Jul 09 05:06:31 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:31 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf" returned: 0 in 0.720s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:31 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf Jul 09 05:06:31 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:31 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20" returned: 0 in 0.648s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:31 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.info Jul 09 05:06:31 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:32 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342.e9d36e51-52b4-40ba-9808-3ce0bb2dacdf" returned: 0 in 0.661s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "cinder-quobyte-e9d36e51-52b4-40ba-9808-3ce0bb2dacdf" released by "_delete_snapshot" :: held 3.019s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "cinder-quobyte-565aabe8-4574-48db-aed4-07944141e342" released by "delete_snapshot" :: held 3.042s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:32 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Created reservations ['5f301e54-91d1-4b76-9137-904b2141091a', 'f1a4bbd2-bdd5-47af-a2d9-0dd35d856fd4', 'b2a20e25-0807-45e7-8d05-54e5e19340fa', 'aa59fca7-bd1c-43b7-b585-8a67b0df8e03'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:32 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Delete snapshot completed successfully. Jul 09 05:06:32 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42e2588a-cbdf-494b-b4ea-0bff29d7421f tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "cinder-e9d36e51-52b4-40ba-9808-3ce0bb2dacdf-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.info" returned: 0 in 0.633s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:32 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.info is being set with open permissions: ugo+rw Jul 09 05:06:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:32 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.info Jul 09 05:06:32 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:33 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.info" returned: 0 in 0.624s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.316s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.482s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-537371402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36f2dba-fb38-473f-8c8c-627a616d60e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ced0737b67c4ea387b9881a69008da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:27Z,use_quota=True,user_id='6ef8fae360d746e8bbea63bec52c68a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Creating volume e36f2dba-fb38-473f-8c8c-627a616d60e5 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:06:33 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:33 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 1073741824 Jul 09 05:06:33 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d9e298ca-f7fe-4f57-8949-a3e1fab89337 tempest-VolumesExtendTest-132858217 None] Create snapshot completed successfully Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Acquiring lock "cinder-565aabe8-4574-48db-aed4-07944141e342-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "cinder-565aabe8-4574-48db-aed4-07944141e342-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Acquiring lock "cinder-quobyte-565aabe8-4574-48db-aed4-07944141e342" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "cinder-quobyte-565aabe8-4574-48db-aed4-07944141e342" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d09d147-a667-435f-aa7e-74e317069cc9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:33 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 Jul 09 05:06:33 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:33 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 1073741824" returned: 0 in 0.870s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:34 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 Jul 09 05:06:34 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ea0db7f2-f536-4778-98c5-90d883ba9b9e tempest-VolumesExtendTest-132858217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:34 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342" returned: 0 in 0.805s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:34 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342 Jul 09 05:06:34 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:34 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5" returned: 0 in 0.739s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.376s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1115282973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698d335f-1a25-4bd7-8697-c3f19edc2246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c741f7f89dd4e46a51d3dc2faba2458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:27Z,use_quota=True,user_id='d82ceafb2881434387424500547c5932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Creating volume 698d335f-1a25-4bd7-8697-c3f19edc2246 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:06:34 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:34 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 1073741824 Jul 09 05:06:34 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676b16ca-194f-4fb4-9e80-690eda6922bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36f2dba-fb38-473f-8c8c-627a616d60e5', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6e10d4-836d-4823-aae0-b0cdf1f4a6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Volume volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 (e36f2dba-fb38-473f-8c8c-627a616d60e5): created successfully Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6e10d4-836d-4823-aae0-b0cdf1f4a6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Flow 'volume_create_manager' (509e9d27-7667-4c8b-99fa-bf5957b9b0b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:34 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7e3e5c2e-4072-48d0-8091-a53c8d0cbf28 tempest-AttachVolumeTestJSON-1224303337 None] Created volume successfully. Jul 09 05:06:35 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-565aabe8-4574-48db-aed4-07944141e342" returned: 0 in 0.637s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "cinder-quobyte-565aabe8-4574-48db-aed4-07944141e342" released by "delete_volume" :: held 1.500s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Created reservations ['23eb7e17-7208-45f3-822b-1b48d82cf9ed', 'a6a161ca-fe50-4ee8-9e80-fbe3a96a426c', 'eaa60391-a783-4760-9d98-e29fba7b4d52', 'a84d9f31-03e3-4ce9-88a0-2b84a4f683c6'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:35 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:06:35 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:35 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 1073741824" returned: 0 in 0.837s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:35 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 Jul 09 05:06:35 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:35 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.731s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:06:35 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Deleted volume successfully. Jul 09 05:06:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b4e265a3-e9a9-46db-8775-c50fb054c944 tempest-VolumesSnapshotNegativeTestJSON-1640089336 None] Lock "cinder-565aabe8-4574-48db-aed4-07944141e342-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:36 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246" returned: 0 in 0.726s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:06:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ea0db7f2-f536-4778-98c5-90d883ba9b9e tempest-VolumesExtendTest-132858217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.180s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:36 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3a33c9-7a2b-4144-82ac-a29a2857fffa]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ea0db7f2-f536-4778-98c5-90d883ba9b9e tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:36 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Attempting download of dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}])) to volume 698d335f-1a25-4bd7-8697-c3f19edc2246. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 05:06:36 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9254e32-88c6-4997-9a6b-a8fdf6ad159e]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_qvqgql_o {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:36 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea Jul 09 05:06:36 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:36 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_qvqgql_o Jul 09 05:06:36 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:37 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ea0db7f2-f536-4778-98c5-90d883ba9b9e tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" returned: 0 in 0.896s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ea0db7f2-f536-4778-98c5-90d883ba9b9e tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 2G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:37 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_qvqgql_o" returned: 0 in 0.848s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_qvqgql_o {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:37 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_qvqgql_o Jul 09 05:06:37 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ea0db7f2-f536-4778-98c5-90d883ba9b9e tempest-VolumesExtendTest-132858217 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 2G" returned: 0 in 0.207s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ea0db7f2-f536-4778-98c5-90d883ba9b9e tempest-VolumesExtendTest-132858217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.155s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:37 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ea0db7f2-f536-4778-98c5-90d883ba9b9e tempest-VolumesExtendTest-132858217 None] Extend volume completed successfully. Jul 09 05:06:38 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_qvqgql_o" returned: 1 in 0.778s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_qvqgql_o' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0324fbf2-6cac-45ca-9b10-6891e3a2242c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:38 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD Jul 09 05:06:38 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Acquiring lock "cinder-35c44b32-c9bc-43b3-bfc4-a65cac960e20-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Lock "cinder-35c44b32-c9bc-43b3-bfc4-a65cac960e20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Acquiring lock "cinder-quobyte-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Lock "cinder-quobyte-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Acquiring lock "cinder-quobyte-35c44b32-c9bc-43b3-bfc4-a65cac960e20" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Lock "cinder-quobyte-35c44b32-c9bc-43b3-bfc4-a65cac960e20" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Deleting offline snapshot 35c44b32-c9bc-43b3-bfc4-a65cac960e20 of volume 8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] snapshot_file for this snap is: volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b22cd4b-2200-4235-89c5-eac73c31f3e6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:39 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 Jul 09 05:06:39 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:39 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:39 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:06:39 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD" returned: 0 in 0.952s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 was qcow2, converting to raw {{(pid=87161) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-7d76b7fe-bdc3-42d8-8728-6755dc7b87e6 req-2c8cc4c3-c60c-4de9-aacc-43a1569f935d tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-7d76b7fe-bdc3-42d8-8728-6755dc7b87e6 req-2c8cc4c3-c60c-4de9-aacc-43a1569f935d tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:39 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 Jul 09 05:06:39 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f066ceb-3468-4a27-bde1-ea403f14333e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-7d76b7fe-bdc3-42d8-8728-6755dc7b87e6 req-2c8cc4c3-c60c-4de9-aacc-43a1569f935d tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:39 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 Jul 09 05:06:39 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:40 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20" returned: 0 in 1.114s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[956986b4-5f04-4ebe-838c-6a54b0b15814]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:40 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.128s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:06:40 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea Jul 09 05:06:40 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:40 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-7d76b7fe-bdc3-42d8-8728-6755dc7b87e6 req-2c8cc4c3-c60c-4de9-aacc-43a1569f935d tempest-AttachVolumeTestJSON-1224303337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5" returned: 0 in 1.077s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-7d76b7fe-bdc3-42d8-8728-6755dc7b87e6 req-2c8cc4c3-c60c-4de9-aacc-43a1569f935d tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.107s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-7d76b7fe-bdc3-42d8-8728-6755dc7b87e6 req-2c8cc4c3-c60c-4de9-aacc-43a1569f935d tempest-AttachVolumeTestJSON-1224303337 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-e36f2dba-fb38-473f-8c8c-627a616d60e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9449b1fe-6e62-4292-b2bc-ecd32dc4c047', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:06:40 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-7d76b7fe-bdc3-42d8-8728-6755dc7b87e6 req-2c8cc4c3-c60c-4de9-aacc-43a1569f935d tempest-AttachVolumeTestJSON-1224303337 None] attachment_update completed successfully. Jul 09 05:06:41 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" returned: 0 in 0.995s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:41 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 Jul 09 05:06:41 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:41 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246" returned: 0 in 2.500s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:41 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_670n4ecpdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:06:41 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Converted 112.00 MB image at 44.77 MB/s Jul 09 05:06:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:41 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 1G Jul 09 05:06:41 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:41 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20" returned: 0 in 0.919s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:42 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20 Jul 09 05:06:42 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:42 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 1G" returned: 0 in 0.866s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:42 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c9c31e-fc50-4792-a046-273764a75d53]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:42 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 Jul 09 05:06:42 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:42 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea.35c44b32-c9bc-43b3-bfc4-a65cac960e20" returned: 0 in 0.768s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Lock "cinder-quobyte-35c44b32-c9bc-43b3-bfc4-a65cac960e20" released by "_delete_snapshot" :: held 3.960s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Lock "cinder-quobyte-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" released by "delete_snapshot" :: held 3.991s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:42 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Created reservations ['e67fc148-b928-4edf-87d2-40f302650a72', 'd1cb706a-b395-4925-b099-c8c71c8c0cd4', 'dccf00bc-3db7-4ffe-8814-e52c47dcf4e9', 'ba34afae-af7f-4ab6-9264-90b9cde6187b'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:42 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Delete snapshot completed successfully. Jul 09 05:06:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-025e72c2-9b71-40b1-aa89-e09354f4f74f tempest-VolumesExtendTest-132858217 None] Lock "cinder-35c44b32-c9bc-43b3-bfc4-a65cac960e20-delete_snapshot" released by "delete_snapshot" :: held 4.162s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Acquiring lock "cinder-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Lock "cinder-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Acquiring lock "cinder-quobyte-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Lock "cinder-quobyte-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4783fd81-aad4-4099-a62a-6346e6ccb999]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:43 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea Jul 09 05:06:43 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:43 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246" returned: 0 in 0.886s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:43 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 Jul 09 05:06:43 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:44 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" returned: 0 in 1.048s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:44 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea Jul 09 05:06:44 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:44 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246" returned: 1 in 1.052s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Downloaded image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}])) to volume 698d335f-1a25-4bd7-8697-c3f19edc2246 successfully. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Temporary image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 for user d82ceafb2881434387424500547c5932 is deleted. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Marking volume 698d335f-1a25-4bd7-8697-c3f19edc2246 as bootable. {{(pid=87161) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Copying metadata from image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 to 698d335f-1a25-4bd7-8697-c3f19edc2246. {{(pid=87161) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Creating volume glance metadata for volume 698d335f-1a25-4bd7-8697-c3f19edc2246 backed by image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87161) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f271c01d-86e4-470f-9bcd-ac0249b57e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-698d335f-1a25-4bd7-8697-c3f19edc2246', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21a2c8e-9470-45fa-a3bb-edefeb3103a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:44 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Volume volume-698d335f-1a25-4bd7-8697-c3f19edc2246 (698d335f-1a25-4bd7-8697-c3f19edc2246): created successfully Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21a2c8e-9470-45fa-a3bb-edefeb3103a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Flow 'volume_create_manager' (2bfd11cc-0ff8-401b-8169-076b922e9c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:44 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-406fafe3-2469-4d4e-8273-73ecabd88182 tempest-VolumesImageMetadata-651679925 None] Created volume successfully. Jul 09 05:06:45 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" returned: 0 in 0.718s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Lock "cinder-quobyte-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea" released by "delete_volume" :: held 1.837s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:45 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Created reservations ['4f3b816f-a062-4238-91f4-f898c26a5354', '2a00bcae-da75-426c-9c61-dbceca813d4a', '4f9a3fdf-8f4d-4295-9382-15ee9a752ba3', 'fc5042b4-663c-497c-8e15-61fe27d9c681'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:45 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:06:45 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Acquiring lock "cinder-698d335f-1a25-4bd7-8697-c3f19edc2246-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Lock "cinder-698d335f-1a25-4bd7-8697-c3f19edc2246-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Acquiring lock "cinder-quobyte-698d335f-1a25-4bd7-8697-c3f19edc2246" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:06:46 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Lock "cinder-quobyte-698d335f-1a25-4bd7-8697-c3f19edc2246" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.997s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:06:46 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Deleted volume successfully. Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8edea48e-97e7-4785-90e4-31ceee270215 tempest-VolumesExtendTest-132858217 None] Lock "cinder-8ca3d4ff-631d-43da-bf2e-7f0fa0b1f2ea-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8798ec5f-6130-4804-8bf9-ff68427ae327]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Flow 'volume_create_manager' (38a90ed8-ae80-4c84-8479-6bc75e44efae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:46 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 Jul 09 05:06:46 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da703994-eddf-4deb-a006-ced8cd8cbf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da703994-eddf-4deb-a006-ced8cd8cbf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1988088638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831c9c05-fff5-4c59-af9b-329a2055d0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ced0737b67c4ea387b9881a69008da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:46Z,use_quota=True,user_id='6ef8fae360d746e8bbea63bec52c68a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b7aa52-4334-4031-827d-ef1111f21978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b7aa52-4334-4031-827d-ef1111f21978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a845ef68-79ce-4b92-a839-45eb5de192fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a845ef68-79ce-4b92-a839-45eb5de192fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '831c9c05-fff5-4c59-af9b-329a2055d0bd', 'volume_name': 'volume-831c9c05-fff5-4c59-af9b-329a2055d0bd', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb7c470-a679-4983-8458-4c892322919b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb7c470-a679-4983-8458-4c892322919b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede24620-af37-4df2-aeb0-f14926545329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:46 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Volume 831c9c05-fff5-4c59-af9b-329a2055d0bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-831c9c05-fff5-4c59-af9b-329a2055d0bd', 'volume_size': 1} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1988088638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831c9c05-fff5-4c59-af9b-329a2055d0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ced0737b67c4ea387b9881a69008da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:46Z,use_quota=True,user_id='6ef8fae360d746e8bbea63bec52c68a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Creating volume 831c9c05-fff5-4c59-af9b-329a2055d0bd {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:06:46 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:06:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:46 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd 1073741824 Jul 09 05:06:46 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:47 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246" returned: 0 in 1.024s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:47 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 Jul 09 05:06:47 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:47 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd 1073741824" returned: 0 in 1.295s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:48 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd Jul 09 05:06:48 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:48 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246" returned: 1 in 1.112s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:06:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:48 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246 Jul 09 05:06:48 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:48 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd" returned: 0 in 0.867s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:06:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.221s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede24620-af37-4df2-aeb0-f14926545329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-831c9c05-fff5-4c59-af9b-329a2055d0bd', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34e7a86-8d64-4c07-bd9b-14364f212b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:48 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Volume volume-831c9c05-fff5-4c59-af9b-329a2055d0bd (831c9c05-fff5-4c59-af9b-329a2055d0bd): created successfully Jul 09 05:06:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34e7a86-8d64-4c07-bd9b-14364f212b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Flow 'volume_create_manager' (38a90ed8-ae80-4c84-8479-6bc75e44efae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:48 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-78f39f99-3d7d-4b2e-8ecf-346eaf935622 tempest-AttachVolumeTestJSON-1224303337 None] Created volume successfully. Jul 09 05:06:49 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-698d335f-1a25-4bd7-8697-c3f19edc2246" returned: 0 in 0.754s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Lock "cinder-quobyte-698d335f-1a25-4bd7-8697-c3f19edc2246" released by "delete_volume" :: held 3.006s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:49 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Created reservations ['76cfd209-bc5e-47d9-ae99-d2a79cd44644', '64046cdf-48b4-4378-8a31-32133b56c35b', '46d9af0c-064f-440a-9788-f4dc2f950d3f', '9d4a8d5c-9ed7-4147-83af-59087e4bc8e0'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:06:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:49 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:06:49 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Flow 'volume_create_manager' (99a1bab3-f904-40a4-9bc4-5d9864d28856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238abf04-c2ac-4bdf-9f4d-fa4458c277e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238abf04-c2ac-4bdf-9f4d-fa4458c277e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1316862315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8319a462-69b3-44c4-9f13-6615270c9545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be167b3768ee44c98b6334f7aa6545e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:50Z,use_quota=True,user_id='d52a417d6f3b4278a41634ceb5981241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23064d65-8cb1-4782-ab45-9d8ce329c983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23064d65-8cb1-4782-ab45-9d8ce329c983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6314b0-1ee3-4540-a324-2c4bf9e15656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6314b0-1ee3-4540-a324-2c4bf9e15656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8319a462-69b3-44c4-9f13-6615270c9545', 'volume_name': 'volume-8319a462-69b3-44c4-9f13-6615270c9545', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd67917-2513-46e2-9f6f-a7e7b85b1453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd67917-2513-46e2-9f6f-a7e7b85b1453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae83bd7-54e3-4621-beca-759c37547f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:50 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Volume 8319a462-69b3-44c4-9f13-6615270c9545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8319a462-69b3-44c4-9f13-6615270c9545', 'volume_size': 1} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1316862315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8319a462-69b3-44c4-9f13-6615270c9545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be167b3768ee44c98b6334f7aa6545e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:50Z,use_quota=True,user_id='d52a417d6f3b4278a41634ceb5981241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Creating volume 8319a462-69b3-44c4-9f13-6615270c9545 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:06:50 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:50 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545 1073741824 Jul 09 05:06:50 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:50 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.138s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:06:50 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Deleted volume successfully. Jul 09 05:06:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-bd80910f-10c3-4ed0-bc0b-7f996d9b7a48 tempest-VolumesImageMetadata-651679925 None] Lock "cinder-698d335f-1a25-4bd7-8697-c3f19edc2246-delete_volume" released by "delete_volume" :: held 4.496s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:06:51 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545 1073741824" returned: 0 in 1.161s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:51 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=110,cinder:UPDATE=133,cinder:INSERT=53,cinder:DELETE=13 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:06:51 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=120,cinder:INSERT=35,cinder:UPDATE=125,cinder:DELETE=6 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:06:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:51 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545 Jul 09 05:06:51 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:52 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545" returned: 0 in 0.828s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:06:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae83bd7-54e3-4621-beca-759c37547f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8319a462-69b3-44c4-9f13-6615270c9545', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf101a4-deed-4ac3-b5cc-5f4c5162af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:52 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Volume volume-8319a462-69b3-44c4-9f13-6615270c9545 (8319a462-69b3-44c4-9f13-6615270c9545): created successfully Jul 09 05:06:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf101a4-deed-4ac3-b5cc-5f4c5162af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Flow 'volume_create_manager' (99a1bab3-f904-40a4-9bc4-5d9864d28856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:52 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ccf5b8af-6989-427a-868d-121bb5a435d7 tempest-VolumesNegativeTest-694311757 None] Created volume successfully. Jul 09 05:06:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-b22fe63e-108b-4390-a5ad-2a0df8f7e210 req-7b55f810-5ce4-4d63-b084-e73b09a48cdc tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-b22fe63e-108b-4390-a5ad-2a0df8f7e210 req-7b55f810-5ce4-4d63-b084-e73b09a48cdc tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:53 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aed9b8-dde8-4d8c-9ea7-060fd8e68de4]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-b22fe63e-108b-4390-a5ad-2a0df8f7e210 req-7b55f810-5ce4-4d63-b084-e73b09a48cdc tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:53 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd Jul 09 05:06:53 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Flow 'volume_create_manager' (afbfc5d3-9111-4447-97be-a87cfd1708fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab69d644-7f9a-4857-8481-c23172842d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab69d644-7f9a-4857-8481-c23172842d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-720158680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04410962-449e-40e8-830a-0b0d0851c7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7fd5819bdc4a238dce6eaaec59e83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:54Z,use_quota=True,user_id='4624c1cf4b7f451d99f897756fa2e0e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e64b93-61f3-41f1-8218-090dee19cb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e64b93-61f3-41f1-8218-090dee19cb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1beb8d-ef29-40f6-9564-fd71577e9106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1beb8d-ef29-40f6-9564-fd71577e9106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04410962-449e-40e8-830a-0b0d0851c7dc', 'volume_name': 'volume-04410962-449e-40e8-830a-0b0d0851c7dc', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd14a7f-cedb-41bb-9eb5-c399ce5788f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd14a7f-cedb-41bb-9eb5-c399ce5788f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a135ecd8-96a2-4115-b11e-f7eb7bff61d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:54 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Volume 04410962-449e-40e8-830a-0b0d0851c7dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04410962-449e-40e8-830a-0b0d0851c7dc', 'volume_size': 1} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:54 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-b22fe63e-108b-4390-a5ad-2a0df8f7e210 req-7b55f810-5ce4-4d63-b084-e73b09a48cdc tempest-AttachVolumeTestJSON-1224303337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd" returned: 0 in 1.030s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-b22fe63e-108b-4390-a5ad-2a0df8f7e210 req-7b55f810-5ce4-4d63-b084-e73b09a48cdc tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.057s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-720158680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04410962-449e-40e8-830a-0b0d0851c7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7fd5819bdc4a238dce6eaaec59e83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:06:54Z,use_quota=True,user_id='4624c1cf4b7f451d99f897756fa2e0e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Creating volume 04410962-449e-40e8-830a-0b0d0851c7dc {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:06:54 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:54 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc 1073741824 Jul 09 05:06:54 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-b22fe63e-108b-4390-a5ad-2a0df8f7e210 req-7b55f810-5ce4-4d63-b084-e73b09a48cdc tempest-AttachVolumeTestJSON-1224303337 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-831c9c05-fff5-4c59-af9b-329a2055d0bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b02a386-dace-4f1c-aa0b-c7ad587ddb4b', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:06:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-b22fe63e-108b-4390-a5ad-2a0df8f7e210 req-7b55f810-5ce4-4d63-b084-e73b09a48cdc tempest-AttachVolumeTestJSON-1224303337 None] attachment_update completed successfully. Jul 09 05:06:55 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc 1073741824" returned: 0 in 1.004s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:55 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc Jul 09 05:06:55 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:56 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc" returned: 0 in 0.693s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:06:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:06:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a135ecd8-96a2-4115-b11e-f7eb7bff61d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04410962-449e-40e8-830a-0b0d0851c7dc', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b24920-f1db-471e-8442-bb691408415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:06:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Volume volume-04410962-449e-40e8-830a-0b0d0851c7dc (04410962-449e-40e8-830a-0b0d0851c7dc): created successfully Jul 09 05:06:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b24920-f1db-471e-8442-bb691408415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:06:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Flow 'volume_create_manager' (afbfc5d3-9111-4447-97be-a87cfd1708fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:06:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b5acac14-0e2f-41f6-aac5-21f507dfee5b tempest-SnapshotMetadataTestJSON-1971408792 None] Created volume successfully. Jul 09 05:06:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:06:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:06:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Creating offline snapshot 594ffc4b-bb5e-4723-ae02-fe44fef83cf5 of volume 04410962-449e-40e8-830a-0b0d0851c7dc {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:06:57 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc41ab1d-be1e-4c5a-9745-38d8e9f45192]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:06:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:57 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc Jul 09 05:06:57 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:58 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc" returned: 0 in 0.808s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:58 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 1G Jul 09 05:06:58 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:06:59 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 09 05:06:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 1G" returned: 0 in 1.284s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:06:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04410962-449e-40e8-830a-0b0d0851c7dc -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:06:59 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04410962-449e-40e8-830a-0b0d0851c7dc -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 Jul 09 05:06:59 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:00 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04410962-449e-40e8-830a-0b0d0851c7dc -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5" returned: 0 in 1.027s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:00 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 is being set with open permissions: ugo+rw Jul 09 05:07:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:00 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 Jul 09 05:07:00 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-599b158a-52a9-4f85-addb-34f8a6677eb7 req-f9dbe85d-d442-4e43-97e9-4ce160888b89 tempest-AttachVolumeTestJSON-1224303337 None] Terminate volume connection completed successfully. Jul 09 05:07:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-599b158a-52a9-4f85-addb-34f8a6677eb7 req-f9dbe85d-d442-4e43-97e9-4ce160888b89 tempest-AttachVolumeTestJSON-1224303337 None] Deleting attachment 9449b1fe-6e62-4292-b2bc-ecd32dc4c047. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:07:01 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5" returned: 0 in 0.864s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:01 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.info Jul 09 05:07:01 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:02 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.info" returned: 0 in 0.843s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:02 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.info is being set with open permissions: ugo+rw Jul 09 05:07:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:02 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.info Jul 09 05:07:02 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:03 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.info" returned: 0 in 0.683s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.646s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-763584a5-7cc2-478e-8051-22866dd3a515 tempest-SnapshotMetadataTestJSON-1971408792 None] Create snapshot completed successfully Jul 09 05:07:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-a888bff7-c257-4a06-a9f0-08b8e6bc526d req-794b40da-70aa-4a18-9b52-e6e6236cf94a tempest-AttachVolumeTestJSON-1224303337 None] Terminate volume connection completed successfully. Jul 09 05:07:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-a888bff7-c257-4a06-a9f0-08b8e6bc526d req-794b40da-70aa-4a18-9b52-e6e6236cf94a tempest-AttachVolumeTestJSON-1224303337 None] Deleting attachment 6b02a386-dace-4f1c-aa0b-c7ad587ddb4b. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:07:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Acquiring lock "cinder-594ffc4b-bb5e-4723-ae02-fe44fef83cf5-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "cinder-594ffc4b-bb5e-4723-ae02-fe44fef83cf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Acquiring lock "cinder-quobyte-04410962-449e-40e8-830a-0b0d0851c7dc" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "cinder-quobyte-04410962-449e-40e8-830a-0b0d0851c7dc" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Acquiring lock "cinder-quobyte-594ffc4b-bb5e-4723-ae02-fe44fef83cf5" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "cinder-quobyte-594ffc4b-bb5e-4723-ae02-fe44fef83cf5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Deleting offline snapshot 594ffc4b-bb5e-4723-ae02-fe44fef83cf5 of volume 04410962-449e-40e8-830a-0b0d0851c7dc {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:07:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] snapshot_file for this snap is: volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:07:04 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d90329f-1490-43f3-a7e0-1b0b168a18e2]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:05 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 Jul 09 05:07:05 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:05 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5" returned: 0 in 0.857s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04410962-449e-40e8-830a-0b0d0851c7dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:07:05 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef57b00-5be0-4b9d-bbcd-78ed5e132357]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:06 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc Jul 09 05:07:06 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:07 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc" returned: 0 in 1.107s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:07 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 Jul 09 05:07:07 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:08 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5" returned: 0 in 1.046s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:08 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5 Jul 09 05:07:08 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:09 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc.594ffc4b-bb5e-4723-ae02-fe44fef83cf5" returned: 0 in 1.014s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "cinder-quobyte-594ffc4b-bb5e-4723-ae02-fe44fef83cf5" released by "_delete_snapshot" :: held 4.221s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "cinder-quobyte-04410962-449e-40e8-830a-0b0d0851c7dc" released by "delete_snapshot" :: held 4.255s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:09 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Created reservations ['ba02d50d-d84b-4b47-a902-6242afe83930', 'd66aee5c-083c-4a8e-98bf-7d4928ce2d75', '6c4c897b-ca9c-40ff-a478-ede85f9c8b3b', 'b040cca7-bd8c-422a-b5a8-78978c305b8c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:07:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Delete snapshot completed successfully. Jul 09 05:07:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-75cf1467-3c57-4cfc-b027-4f21ab46eda6 tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "cinder-594ffc4b-bb5e-4723-ae02-fe44fef83cf5-delete_snapshot" released by "delete_snapshot" :: held 4.447s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Acquiring lock "cinder-04410962-449e-40e8-830a-0b0d0851c7dc-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "cinder-04410962-449e-40e8-830a-0b0d0851c7dc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Acquiring lock "cinder-quobyte-04410962-449e-40e8-830a-0b0d0851c7dc" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "cinder-quobyte-04410962-449e-40e8-830a-0b0d0851c7dc" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:10 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2924cedd-1bd7-436d-be6d-8539af441369]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:10 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc Jul 09 05:07:10 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:11 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc" returned: 0 in 0.943s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:11 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc Jul 09 05:07:11 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:12 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-04410962-449e-40e8-830a-0b0d0851c7dc" returned: 0 in 0.774s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "cinder-quobyte-04410962-449e-40e8-830a-0b0d0851c7dc" released by "delete_volume" :: held 1.812s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:12 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Created reservations ['ffba0cca-f4c9-424b-bb66-c2545cf6c89a', 'fc28d05e-b7d4-4dde-a9b6-9996d2eaf24e', '066a8c49-9eea-4ca1-8544-1811d81886fc', 'e4463670-5265-4df1-9ac0-03373f290806'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:07:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:12 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:07:12 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:13 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.852s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:13 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:07:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Deleted volume successfully. Jul 09 05:07:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ae9807b1-635c-4750-bf66-4c0c82d2d49b tempest-SnapshotMetadataTestJSON-1971408792 None] Lock "cinder-04410962-449e-40e8-830a-0b0d0851c7dc-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:16 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:07:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (61f720d3-405a-4788-a801-63090656b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c415a317-72ca-4e50-af0f-f9ecf55bbd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c415a317-72ca-4e50-af0f-f9ecf55bbd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-331805807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8b8df9-2c38-4392-a3ad-0153ccc19a5f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:17Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58543c9-ad81-4f53-9a79-ebc8be7d5e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58543c9-ad81-4f53-9a79-ebc8be7d5e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b70633-718b-4554-849f-cd73235d2972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b70633-718b-4554-849f-cd73235d2972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8b8df9-2c38-4392-a3ad-0153ccc19a5f', 'volume_name': 'volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16217906-dccb-43b1-9cbc-86d8bb8b5f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16217906-dccb-43b1-9cbc-86d8bb8b5f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1d5a5f-9ace-4c17-8ae9-48a95515f3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:17 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Volume 3d8b8df9-2c38-4392-a3ad-0153ccc19a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f', 'volume_size': 1} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-331805807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8b8df9-2c38-4392-a3ad-0153ccc19a5f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:17Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Creating volume 3d8b8df9-2c38-4392-a3ad-0153ccc19a5f {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:07:17 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:17 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f 1073741824 Jul 09 05:07:17 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "cinder-831c9c05-fff5-4c59-af9b-329a2055d0bd-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-831c9c05-fff5-4c59-af9b-329a2055d0bd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "cinder-quobyte-831c9c05-fff5-4c59-af9b-329a2055d0bd" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-quobyte-831c9c05-fff5-4c59-af9b-329a2055d0bd" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:18 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[706bab98-11e4-4231-8727-6bacd0f88eb1]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:18 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd Jul 09 05:07:18 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:18 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f 1073741824" returned: 0 in 1.177s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:18 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f Jul 09 05:07:18 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:18 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd" returned: 0 in 0.803s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:18 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd Jul 09 05:07:18 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:18 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f" returned: 0 in 0.710s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:07:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1d5a5f-9ace-4c17-8ae9-48a95515f3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5cf4a4-7bfc-4e15-ac6e-49c52e1c775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:19 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Volume volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f (3d8b8df9-2c38-4392-a3ad-0153ccc19a5f): created successfully Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5cf4a4-7bfc-4e15-ac6e-49c52e1c775f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (61f720d3-405a-4788-a801-63090656b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f9415dbf-0c8a-46e6-beb8-5f1210799791 tempest-VolumesGetTest-217374597 None] Created volume successfully. Jul 09 05:07:19 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-831c9c05-fff5-4c59-af9b-329a2055d0bd" returned: 0 in 0.775s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-quobyte-831c9c05-fff5-4c59-af9b-329a2055d0bd" released by "delete_volume" :: held 1.631s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Created reservations ['4998627c-01bd-4da1-8737-5194542733af', '9e9fc3d4-9f4b-42b6-a565-fb77cf5dc687', '75bfa0dc-e18c-499e-9a05-942b163c1a48', 'ce3b096d-2059-49cc-8b1b-2fd8ef9f7e5b'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:19 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:07:19 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "cinder-e36f2dba-fb38-473f-8c8c-627a616d60e5-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-e36f2dba-fb38-473f-8c8c-627a616d60e5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "cinder-quobyte-e36f2dba-fb38-473f-8c8c-627a616d60e5" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-quobyte-e36f2dba-fb38-473f-8c8c-627a616d60e5" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d2229a-15b2-4891-b34f-d37bc71573c0]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:20 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.685s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:07:20 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Deleted volume successfully. Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6a944481-5a1d-476e-b546-43dd68f99306 tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-831c9c05-fff5-4c59-af9b-329a2055d0bd-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:20 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 Jul 09 05:07:20 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (d0ad8c4f-8235-4578-9523-34af9a41f584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051353d3-2f53-4955-9144-62f00181e210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051353d3-2f53-4955-9144-62f00181e210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1806538216',display_name='tempest-VolumesGetTest-Volume-1744658304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286374d9-2682-46ff-b8ee-235e8af20f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:21Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23bafaf-fccd-41ee-a54f-5b2d6f13c5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23bafaf-fccd-41ee-a54f-5b2d6f13c5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71a1aa9-b1a0-44e1-a241-f6735c71e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71a1aa9-b1a0-44e1-a241-f6735c71e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286374d9-2682-46ff-b8ee-235e8af20f6c', 'volume_name': 'volume-286374d9-2682-46ff-b8ee-235e8af20f6c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b558fa-03e0-44fc-84e4-4d572928600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b558fa-03e0-44fc-84e4-4d572928600b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e2c748-d48f-47e2-8279-ba01da03615d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:21 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Volume 286374d9-2682-46ff-b8ee-235e8af20f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286374d9-2682-46ff-b8ee-235e8af20f6c', 'volume_size': 1} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1806538216',display_name='tempest-VolumesGetTest-Volume-1744658304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286374d9-2682-46ff-b8ee-235e8af20f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:21Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Creating volume 286374d9-2682-46ff-b8ee-235e8af20f6c {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:07:21 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:21 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c 1073741824 Jul 09 05:07:21 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:21 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5" returned: 0 in 1.254s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:21 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5 Jul 09 05:07:21 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:22 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c 1073741824" returned: 0 in 1.174s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:22 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c Jul 09 05:07:22 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:22 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e36f2dba-fb38-473f-8c8c-627a616d60e5" returned: 0 in 0.781s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-quobyte-e36f2dba-fb38-473f-8c8c-627a616d60e5" released by "delete_volume" :: held 2.108s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Created reservations ['ce40ac07-a334-460a-8224-a04f36f80c40', '3038db89-249b-4933-ada6-ce504697b9ae', 'ac5e9c9b-344f-4f08-90fc-9bacab840163', 'adb97474-d52c-44cd-b415-d0bb869d72e7'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:22 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:07:22 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:23 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c" returned: 0 in 0.842s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e2c748-d48f-47e2-8279-ba01da03615d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286374d9-2682-46ff-b8ee-235e8af20f6c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0b03ca-5a1d-40a8-9af8-996be52a61f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:23 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Volume volume-286374d9-2682-46ff-b8ee-235e8af20f6c (286374d9-2682-46ff-b8ee-235e8af20f6c): created successfully Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0b03ca-5a1d-40a8-9af8-996be52a61f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (d0ad8c4f-8235-4578-9523-34af9a41f584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:23 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3931160a-7d4d-4f4d-88c9-f654a6a6aca5 tempest-VolumesGetTest-217374597 None] Created volume successfully. Jul 09 05:07:23 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.865s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:07:23 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Deleted volume successfully. Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-94f91cba-a6eb-4109-9669-1bfe049527e9 tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-e36f2dba-fb38-473f-8c8c-627a616d60e5-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "cinder-ebd0e2b9-6261-48ce-901b-00a1f271fcd8-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-ebd0e2b9-6261-48ce-901b-00a1f271fcd8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "cinder-quobyte-ebd0e2b9-6261-48ce-901b-00a1f271fcd8" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-quobyte-ebd0e2b9-6261-48ce-901b-00a1f271fcd8" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d68f2-ee51-4688-b692-bc20ea12d39f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:24 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 Jul 09 05:07:24 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-286374d9-2682-46ff-b8ee-235e8af20f6c-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Lock "cinder-286374d9-2682-46ff-b8ee-235e8af20f6c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-quobyte-286374d9-2682-46ff-b8ee-235e8af20f6c" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-286374d9-2682-46ff-b8ee-235e8af20f6c" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:24 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ad1f49-88c7-4f61-a52a-8c0aec1036dd]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:24 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c Jul 09 05:07:24 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:25 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8" returned: 0 in 1.184s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:25 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8 Jul 09 05:07:25 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:25 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c" returned: 0 in 1.052s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:25 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c Jul 09 05:07:25 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:26 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ebd0e2b9-6261-48ce-901b-00a1f271fcd8" returned: 0 in 1.152s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-quobyte-ebd0e2b9-6261-48ce-901b-00a1f271fcd8" released by "delete_volume" :: held 2.410s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Created reservations ['354c275f-a309-403f-acb0-2ed5be9e953c', 'cd5c284d-7d0e-4e33-8082-0f6026f30fa9', '2ff036f1-7d2e-41a7-a6e8-fb87995569c1', '3131c3d9-18c8-4359-ac46-c2981996dbe3'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:26 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:07:26 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:26 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-286374d9-2682-46ff-b8ee-235e8af20f6c" returned: 0 in 0.998s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-286374d9-2682-46ff-b8ee-235e8af20f6c" released by "delete_volume" :: held 2.134s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Created reservations ['774a3231-e72a-4101-a355-1e76ab415722', '18582199-fcae-474d-834c-7fa2bd8609bc', '09e2a282-556d-4da9-911e-775880a2faa0', 'c39e42c3-a1c0-4a6b-ba5b-ba01109b5f2d'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:26 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:07:26 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Lock "cinder-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:27 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.498s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:28 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:07:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Deleted volume successfully. Jul 09 05:07:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e85ecf79-52fd-454e-8fe8-2452a9bcfbad tempest-AttachVolumeTestJSON-1224303337 None] Lock "cinder-ebd0e2b9-6261-48ce-901b-00a1f271fcd8-delete_volume" released by "delete_volume" :: held 4.280s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-quobyte-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:28 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7537fe14-e1f5-4b36-bb48-521f07320ac9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:28 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.273s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:28 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:07:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Deleted volume successfully. Jul 09 05:07:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-64d12941-5070-4f8b-87dc-826f6f096e90 tempest-VolumesGetTest-217374597 None] Lock "cinder-286374d9-2682-46ff-b8ee-235e8af20f6c-delete_volume" released by "delete_volume" :: held 3.854s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:28 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f Jul 09 05:07:28 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:29 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f" returned: 0 in 1.319s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:29 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f Jul 09 05:07:29 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:30 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f" returned: 0 in 0.907s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f" released by "delete_volume" :: held 2.301s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:30 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Created reservations ['c5e29703-178a-420a-b76a-986ee98f54d9', 'b2995bd0-7151-4f76-8d02-0419908951a4', 'ac3081e2-0b6d-45ed-a39b-ddbb59d5061d', 'e6b3f5fc-b2f2-4747-b9de-0170be8a3dd1'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:07:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:30 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:07:30 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:31 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.995s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:31 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:07:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Deleted volume successfully. Jul 09 05:07:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-92a35272-bac9-4e6b-9052-e746dfb13da1 tempest-VolumesGetTest-217374597 None] Lock "cinder-3d8b8df9-2c38-4392-a3ad-0153ccc19a5f-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (fc2ea96e-ce76-4008-96f1-8f1b818fba4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6a8f49-63e3-4628-91e1-d79a7ebbc013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6a8f49-63e3-4628-91e1-d79a7ebbc013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1717830783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:32Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caac0882-b8eb-4148-b0de-6a14b04907a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caac0882-b8eb-4148-b0de-6a14b04907a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03da4c01-6e6b-4d8c-8f21-4f8bcbd559b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03da4c01-6e6b-4d8c-8f21-4f8bcbd559b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4', 'volume_name': 'volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93ccee4-9c9d-4281-b362-2cf11f81cdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93ccee4-9c9d-4281-b362-2cf11f81cdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8fc955-76df-426d-a5e7-5cace6684035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:32 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Volume aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4', 'volume_size': 1} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1717830783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:32Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Creating volume aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:07:32 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:32 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 1073741824 Jul 09 05:07:32 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Acquiring lock "cinder-8319a462-69b3-44c4-9f13-6615270c9545-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Lock "cinder-8319a462-69b3-44c4-9f13-6615270c9545-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Acquiring lock "cinder-quobyte-8319a462-69b3-44c4-9f13-6615270c9545" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Lock "cinder-quobyte-8319a462-69b3-44c4-9f13-6615270c9545" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff56cd8-5fd0-47bc-a481-6daed33e6adf]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:33 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545 Jul 09 05:07:33 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:33 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 1073741824" returned: 0 in 1.344s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:33 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 Jul 09 05:07:33 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:33 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545" returned: 0 in 1.000s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:33 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545 Jul 09 05:07:33 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:34 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4" returned: 0 in 0.832s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8fc955-76df-426d-a5e7-5cace6684035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81747217-dd05-4b00-8db8-ccff2c11d5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Volume volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 (aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4): created successfully Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81747217-dd05-4b00-8db8-ccff2c11d5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (fc2ea96e-ce76-4008-96f1-8f1b818fba4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:34 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-90a2a389-f4a7-4d5f-b81e-5d10e447b0b4 tempest-VolumesGetTest-217374597 None] Created volume successfully. Jul 09 05:07:34 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8319a462-69b3-44c4-9f13-6615270c9545" returned: 0 in 0.897s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Lock "cinder-quobyte-8319a462-69b3-44c4-9f13-6615270c9545" released by "delete_volume" :: held 1.944s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Created reservations ['df080ac9-2e5b-4108-90fa-04c9f578d83c', 'd81ae44e-427f-40fc-9ac5-df4188c629c6', '300731c7-4ed6-4131-83e8-002b92ebc65d', 'f5d325e7-e525-4ec0-8ce7-27ea1a8a55da'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:35 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:07:35 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:36 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.090s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:07:36 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Deleted volume successfully. Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a4fbe7bc-b66c-402a-beeb-8b275cf60846 tempest-VolumesNegativeTest-694311757 None] Lock "cinder-8319a462-69b3-44c4-9f13-6615270c9545-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (026b0db2-d14a-491a-80c7-de9aeaa88459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4352dc-dcbd-4b86-86c2-84c39eb2eceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4352dc-dcbd-4b86-86c2-84c39eb2eceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2075700883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b2d1bb-88f7-4eec-b245-191b3cf05c5b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:37Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52294602-04de-44ad-ad2d-c80106f5b2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52294602-04de-44ad-ad2d-c80106f5b2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a225874c-7304-4ab2-882a-353b133b78f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a225874c-7304-4ab2-882a-353b133b78f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '65b2d1bb-88f7-4eec-b245-191b3cf05c5b', 'volume_name': 'volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b', 'volume_size': 1, 'source_volid': 'aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4', 'source_volstatus': 'available'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab53de8c-882f-43a9-a746-d2a4436b5638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab53de8c-882f-43a9-a746-d2a4436b5638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebd6da6-37b6-4a78-adde-4843054274d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:36 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Volume 65b2d1bb-88f7-4eec-b245-191b3cf05c5b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b', 'volume_size': 1, 'source_volid': 'aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4', 'source_volstatus': 'available'} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:36 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Cloning volume aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 to volume 65b2d1bb-88f7-4eec-b245-191b3cf05c5b Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Creating offline snapshot fd27f940-b191-417c-9f6c-531384e65f0a of volume aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[038a71fa-79c2-43d5-88fa-7edd34c849d9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:36 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 Jul 09 05:07:36 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:37 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4" returned: 0 in 0.828s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:37 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a 1G Jul 09 05:07:37 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Flow 'volume_create_manager' (dc799587-7b57-494e-ba2f-fe3506cdcb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948f8cf9-2c36-41fa-97c5-f7e16ac4f334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948f8cf9-2c36-41fa-97c5-f7e16ac4f334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1222230489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7819475-1eae-4432-89fd-ed783023913f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66a36be07c4e4ff6807de15e6e6917d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:38Z,use_quota=True,user_id='96c572398a59403fa7db0949d14998c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5ab307-212b-4757-a427-c30a9fc76dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5ab307-212b-4757-a427-c30a9fc76dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a896096d-03c7-4dc3-8766-dc842225ef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a896096d-03c7-4dc3-8766-dc842225ef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7819475-1eae-4432-89fd-ed783023913f', 'volume_name': 'volume-d7819475-1eae-4432-89fd-ed783023913f', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1012463-b1cf-4020-b74c-b678203a1e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1012463-b1cf-4020-b74c-b678203a1e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d6cb2d-feb1-437e-aaa2-b4e68ac6528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:38 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Volume d7819475-1eae-4432-89fd-ed783023913f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7819475-1eae-4432-89fd-ed783023913f', 'volume_size': 1} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:38 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a 1G" returned: 0 in 0.905s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:38 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a Jul 09 05:07:38 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:39 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:07:39 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:39 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a" returned: 0 in 0.783s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:39 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a is being set with open permissions: ugo+rw Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:39 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a Jul 09 05:07:39 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:39 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.689s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:07:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:07:40 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a" returned: 0 in 0.660s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:40 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.info Jul 09 05:07:40 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:40 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.info" returned: 0 in 0.662s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:40 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.info is being set with open permissions: ugo+rw Jul 09 05:07:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:40 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.info Jul 09 05:07:40 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:41 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.info" returned: 0 in 0.643s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-quobyte-65b2d1bb-88f7-4eec-b245-191b3cf05c5b" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-65b2d1bb-88f7-4eec-b245-191b3cf05c5b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] snapshot: fd27f940-b191-417c-9f6c-531384e65f0a, volume: 65b2d1bb-88f7-4eec-b245-191b3cf05c5b, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7adfcb8-3d70-447b-b748-dd8f88ff1780]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:41 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a Jul 09 05:07:41 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:42 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a" returned: 0 in 0.753s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:07:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:07:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:07:42 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8106a261-8fde-4912-8f76-b340bbfef1cb]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:42 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 Jul 09 05:07:42 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:43 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4" returned: 0 in 0.896s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:43 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:07:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:43 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b Jul 09 05:07:43 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:48 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=93,cinder:DELETE=5,cinder:SELECT=58,cinder:INSERT=19 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:07:49 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b" returned: 0 in 6.134s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f4ccfd-2c71-4851-b22a-59e7da9c1830]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:49 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 Jul 09 05:07:49 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Flow 'volume_create_manager' (5960b008-f2b8-4120-809e-def07be56647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6121da-ba42-4413-9d0a-f59e26b1de18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6121da-ba42-4413-9d0a-f59e26b1de18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2048614590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0bb0ad3264c46caa8448a4ffae071aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:49Z,use_quota=True,user_id='6824196b38c14106b32ed95d6231601c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b611c2-5683-413b-8db6-96ef724341ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b611c2-5683-413b-8db6-96ef724341ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfb2c81-62cf-4b91-b646-548b2f544e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfb2c81-62cf-4b91-b646-548b2f544e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6', 'volume_name': 'volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a836b72-2a6a-4906-a7f1-cb3f437e31b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a836b72-2a6a-4906-a7f1-cb3f437e31b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04171e18-4970-4826-b49d-66a7d863b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:49 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Volume eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6', 'volume_size': 1} Jul 09 05:07:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:50 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4" returned: 0 in 1.073s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:50 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:07:50 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Converted 1024.00 MB image at 166.91 MB/s Jul 09 05:07:50 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b is being set with open permissions: ugo+rw Jul 09 05:07:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:50 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b Jul 09 05:07:50 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:51 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b" returned: 0 in 0.804s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-65b2d1bb-88f7-4eec-b245-191b3cf05c5b" released by "_copy_volume_from_snapshot" :: held 9.764s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-quobyte-fd27f940-b191-417c-9f6c-531384e65f0a" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-fd27f940-b191-417c-9f6c-531384e65f0a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Deleting offline snapshot fd27f940-b191-417c-9f6c-531384e65f0a of volume aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:07:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] snapshot_file for this snap is: volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:07:51 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[301b4318-c248-4363-ad02-508529b124cc]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:51 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a Jul 09 05:07:51 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:52 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a" returned: 0 in 0.774s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:07:52 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69f46a6-d543-45f6-87b7-cf92b3586efb]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:52 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 Jul 09 05:07:52 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:52 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4" returned: 0 in 0.837s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:52 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a Jul 09 05:07:52 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:53 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a" returned: 0 in 0.759s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:53 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a Jul 09 05:07:53 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:54 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4.fd27f940-b191-417c-9f6c-531384e65f0a" returned: 0 in 0.643s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-fd27f940-b191-417c-9f6c-531384e65f0a" released by "_delete_snapshot" :: held 3.116s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=74,cinder:INSERT=21,cinder:UPDATE=69,cinder:DELETE=8 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.566s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.036s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1222230489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7819475-1eae-4432-89fd-ed783023913f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66a36be07c4e4ff6807de15e6e6917d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:38Z,use_quota=True,user_id='96c572398a59403fa7db0949d14998c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Creating volume d7819475-1eae-4432-89fd-ed783023913f {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:07:54 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:54 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f 1073741824 Jul 09 05:07:54 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebd6da6-37b6-4a78-adde-4843054274d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b', 'volume_size': 1, 'source_volid': 'aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4', 'source_volstatus': 'available'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7991fc97-18a7-4742-a1d7-0c8dcd3f9316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:54 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Volume volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b (65b2d1bb-88f7-4eec-b245-191b3cf05c5b): created successfully Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7991fc97-18a7-4742-a1d7-0c8dcd3f9316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (026b0db2-d14a-491a-80c7-de9aeaa88459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-02793785-1157-4a59-a37d-445864931b82 tempest-VolumesGetTest-217374597 None] Created volume successfully. Jul 09 05:07:55 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f 1073741824" returned: 0 in 1.040s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:55 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f Jul 09 05:07:55 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:55 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (298d9706-980b-4a9e-9a42-d1eee29674d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071b20a2-c157-4f10-bc69-3f1c1fa773b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071b20a2-c157-4f10-bc69-3f1c1fa773b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-467771734',display_name='tempest-VolumesGetTest-Volume-984796030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c27f59-d954-4739-8cc6-869f805aa7db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:56Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f086c021-29b9-44da-9b0f-056f7ea8ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f086c021-29b9-44da-9b0f-056f7ea8ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1703ee-c971-47db-98a5-4b869c6fc396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1703ee-c971-47db-98a5-4b869c6fc396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c27f59-d954-4739-8cc6-869f805aa7db', 'volume_name': 'volume-98c27f59-d954-4739-8cc6-869f805aa7db', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb3e41f-014f-4cd0-8e7d-41e9efd9a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb3e41f-014f-4cd0-8e7d-41e9efd9a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08268fb4-724d-4099-a70e-237a1f0ad6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Volume 98c27f59-d954-4739-8cc6-869f805aa7db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c27f59-d954-4739-8cc6-869f805aa7db', 'volume_size': 1} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:56 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f" returned: 0 in 0.844s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.698s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2048614590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0bb0ad3264c46caa8448a4ffae071aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:49Z,use_quota=True,user_id='6824196b38c14106b32ed95d6231601c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Creating volume eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:07:56 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:56 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 1073741824 Jul 09 05:07:56 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d6cb2d-feb1-437e-aaa2-b4e68ac6528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7819475-1eae-4432-89fd-ed783023913f', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f343b2-d885-448a-8724-3cff0f846abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Volume volume-d7819475-1eae-4432-89fd-ed783023913f (d7819475-1eae-4432-89fd-ed783023913f): created successfully Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f343b2-d885-448a-8724-3cff0f846abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Flow 'volume_create_manager' (dc799587-7b57-494e-ba2f-fe3506cdcb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-6a4df838-69aa-4b27-8614-c043e9a84b73 req-3abf5d9a-586c-4cd2-bee8-7a5b4e8c6c4d tempest-VolumesGetTestJSON-330415891 None] Created volume successfully. Jul 09 05:07:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Acquiring lock "cinder-d7819475-1eae-4432-89fd-ed783023913f-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Lock "cinder-d7819475-1eae-4432-89fd-ed783023913f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Acquiring lock "cinder-quobyte-d7819475-1eae-4432-89fd-ed783023913f" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:07:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Lock "cinder-quobyte-d7819475-1eae-4432-89fd-ed783023913f" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:07:57 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf23ed4-f68e-4402-8219-5870c76488e6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:07:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:57 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f Jul 09 05:07:57 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:57 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 1073741824" returned: 0 in 1.087s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:57 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 Jul 09 05:07:57 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:57 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f" returned: 0 in 0.814s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:57 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f Jul 09 05:07:57 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:58 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6" returned: 0 in 0.678s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:07:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-467771734',display_name='tempest-VolumesGetTest-Volume-984796030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c27f59-d954-4739-8cc6-869f805aa7db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:07:56Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Creating volume 98c27f59-d954-4739-8cc6-869f805aa7db {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:07:58 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04171e18-4970-4826-b49d-66a7d863b96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:58 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db 1073741824 Jul 09 05:07:58 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2222e7b2-29f6-4ed1-b801-d083b0ce4730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:07:58 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Volume volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 (eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6): created successfully Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2222e7b2-29f6-4ed1-b801-d083b0ce4730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Flow 'volume_create_manager' (5960b008-f2b8-4120-809e-def07be56647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:07:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0102a49c-2776-4d88-a5d9-75e2c5a57fc4 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Created volume successfully. Jul 09 05:07:58 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d7819475-1eae-4432-89fd-ed783023913f" returned: 0 in 0.807s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Lock "cinder-quobyte-d7819475-1eae-4432-89fd-ed783023913f" released by "delete_volume" :: held 1.676s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.quota [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Created reservations ['52c96d06-0f58-4659-b072-d937129116ea', 'cd51dec9-a1fe-4a80-9f4f-f1683164a359', 'c6641d68-3ecb-4139-8ecd-d2f457e9560a', 'e307639a-57ed-4d2d-ac2d-aa1f25aff253'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:07:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:58 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:07:58 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:59 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db 1073741824" returned: 0 in 1.095s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:07:59 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db Jul 09 05:07:59 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:07:59 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Jul 09 05:07:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.809s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:07:59 devstack cinder-volume[87161]: DEBUG cinder.manager [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:07:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Deleted volume successfully. Jul 09 05:07:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-9803cb7e-ba12-410c-83a2-081b02476da3 req-74e4ecf2-a04f-422f-be03-8ce2e9f9b103 tempest-VolumesGetTestJSON-330415891 None] Lock "cinder-d7819475-1eae-4432-89fd-ed783023913f-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:00 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db" returned: 0 in 0.883s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08268fb4-724d-4099-a70e-237a1f0ad6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c27f59-d954-4739-8cc6-869f805aa7db', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01a6832-e1a4-4bea-be34-f82d2e10ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:00 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Volume volume-98c27f59-d954-4739-8cc6-869f805aa7db (98c27f59-d954-4739-8cc6-869f805aa7db): created successfully Jul 09 05:08:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01a6832-e1a4-4bea-be34-f82d2e10ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (298d9706-980b-4a9e-9a42-d1eee29674d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-cc540fe5-7125-4932-8eb3-8d4e8538f247 tempest-VolumesGetTest-217374597 None] Created volume successfully. Jul 09 05:08:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-98c27f59-d954-4739-8cc6-869f805aa7db-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Lock "cinder-98c27f59-d954-4739-8cc6-869f805aa7db-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-quobyte-98c27f59-d954-4739-8cc6-869f805aa7db" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-98c27f59-d954-4739-8cc6-869f805aa7db" acquired by "delete_volume" :: waited 0.037s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:01 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f6abcb-2540-4868-94c1-c53e871fa5ae]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:01 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db Jul 09 05:08:01 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-9144323f-e1a8-4967-b2d5-351bd0de2494 req-88f31de4-01c4-4943-99e1-63d9d4f76e84 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-9144323f-e1a8-4967-b2d5-351bd0de2494 req-88f31de4-01c4-4943-99e1-63d9d4f76e84 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:02 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db" returned: 0 in 1.182s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:02 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9633e4-3859-4cf2-989d-3a4015e3585c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-9144323f-e1a8-4967-b2d5-351bd0de2494 req-88f31de4-01c4-4943-99e1-63d9d4f76e84 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:02 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db Jul 09 05:08:02 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:02 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 Jul 09 05:08:02 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:03 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-98c27f59-d954-4739-8cc6-869f805aa7db" returned: 0 in 0.763s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-98c27f59-d954-4739-8cc6-869f805aa7db" released by "delete_volume" :: held 2.013s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Created reservations ['a6b728e4-d906-4ff3-841a-2a9bc26d0e2d', '87ef2ea8-2aed-4537-ae7f-5c0de913e827', 'fc1ab6e6-8c70-4aa5-adb7-157d9b90583a', '9541bece-59df-47bf-803e-1604c8fc8baa'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:08:03 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-9144323f-e1a8-4967-b2d5-351bd0de2494 req-88f31de4-01c4-4943-99e1-63d9d4f76e84 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6" returned: 0 in 0.882s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-9144323f-e1a8-4967-b2d5-351bd0de2494 req-88f31de4-01c4-4943-99e1-63d9d4f76e84 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.910s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-9144323f-e1a8-4967-b2d5-351bd0de2494 req-88f31de4-01c4-4943-99e1-63d9d4f76e84 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c51f07e-dacb-4420-b653-df354a586340', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:03 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:03 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-9144323f-e1a8-4967-b2d5-351bd0de2494 req-88f31de4-01c4-4943-99e1-63d9d4f76e84 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] attachment_update completed successfully. Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Flow 'volume_create_manager' (30d825f1-cab6-4bd0-9ce2-4b9e060a6fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a017fb76-4f98-4827-9bf2-466ac430a5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-65b2d1bb-88f7-4eec-b245-191b3cf05c5b-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a017fb76-4f98-4827-9bf2-466ac430a5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-908640076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a2e0b8-647d-455d-9945-9a01bac5d14f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aada75edd9634537b651e54591880566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:04Z,use_quota=True,user_id='56709f66be074e0f98471a7e40b3b3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0b867a-2877-47b4-8a3e-f04d9b2a22db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0b867a-2877-47b4-8a3e-f04d9b2a22db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1f5d0f-fed5-4422-8e2b-7d95b11258f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1f5d0f-fed5-4422-8e2b-7d95b11258f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a2e0b8-647d-455d-9945-9a01bac5d14f', 'volume_name': 'volume-01a2e0b8-647d-455d-9945-9a01bac5d14f', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75065380-0e75-443a-8fd8-d99fa68fdb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75065380-0e75-443a-8fd8-d99fa68fdb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff770d0-90a0-480f-b639-699bb60a58fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:04 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:04 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Volume 01a2e0b8-647d-455d-9945-9a01bac5d14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a2e0b8-647d-455d-9945-9a01bac5d14f', 'volume_size': 1} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-908640076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a2e0b8-647d-455d-9945-9a01bac5d14f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aada75edd9634537b651e54591880566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:04Z,use_quota=True,user_id='56709f66be074e0f98471a7e40b3b3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Creating volume 01a2e0b8-647d-455d-9945-9a01bac5d14f {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:04 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.888s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Lock "cinder-65b2d1bb-88f7-4eec-b245-191b3cf05c5b-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:04 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f 1073741824 Jul 09 05:08:04 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Deleted volume successfully. Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-quobyte-65b2d1bb-88f7-4eec-b245-191b3cf05c5b" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec31a26-1b30-4030-92df-89a9d17ae52b tempest-VolumesGetTest-217374597 None] Lock "cinder-98c27f59-d954-4739-8cc6-869f805aa7db-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-65b2d1bb-88f7-4eec-b245-191b3cf05c5b" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7371799-f939-447d-8f28-ca13d4cba20d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:04 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b Jul 09 05:08:04 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:05 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f 1073741824" returned: 0 in 0.994s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:05 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b" returned: 0 in 0.953s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:05 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f Jul 09 05:08:05 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:05 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b Jul 09 05:08:05 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:06 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f" returned: 0 in 0.695s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff770d0-90a0-480f-b639-699bb60a58fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a2e0b8-647d-455d-9945-9a01bac5d14f', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3c3389-8fd8-41ad-a91d-33ba5c173f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:06 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-65b2d1bb-88f7-4eec-b245-191b3cf05c5b" returned: 0 in 0.728s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:06 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Volume volume-01a2e0b8-647d-455d-9945-9a01bac5d14f (01a2e0b8-647d-455d-9945-9a01bac5d14f): created successfully Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3c3389-8fd8-41ad-a91d-33ba5c173f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Flow 'volume_create_manager' (30d825f1-cab6-4bd0-9ce2-4b9e060a6fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-65b2d1bb-88f7-4eec-b245-191b3cf05c5b" released by "delete_volume" :: held 1.753s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:06 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7c9453a7-8dc0-4cc9-a4e6-2f87a8aa6026 tempest-VolumesTestJSON-1970602894 None] Created volume successfully. Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Created reservations ['b26da554-5a4a-4015-8f15-338a604b192e', '0b629710-b2b3-4f0c-84ac-67103203b366', '2165d979-d217-462f-9b35-d811f0a40eaf', 'f27edcdc-cc21-4e1c-b047-a48916daea0e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:06 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:06 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Flow 'volume_create_manager' (f215b3d7-196b-4b66-a7ff-d95f79c8ad27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6c3469-c433-4d96-ac35-f4880ea4cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6c3469-c433-4d96-ac35-f4880ea4cbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-475625166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2930bc8661c430695d5ca5384af0def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:07Z,use_quota=True,user_id='6b01296ddc8548168bdd5897f6107f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(566e62da-6dd8-4637-9b51-49dca7c7eed6),volume_type_id=566e62da-6dd8-4637-9b51-49dca7c7eed6)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d401a9cb-9527-46d4-8f82-b0d377db1576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d401a9cb-9527-46d4-8f82-b0d377db1576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927059f6-0782-4bc6-a83e-710513e842fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927059f6-0782-4bc6-a83e-710513e842fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf', 'volume_name': 'volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3d2d20-840f-4922-baf4-8d8d00327f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3d2d20-840f-4922-baf4-8d8d00327f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9873bab9-0890-459b-89d4-8f21dd6bbdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:06 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Volume 9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf', 'volume_size': 1} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-475625166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2930bc8661c430695d5ca5384af0def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:07Z,use_quota=True,user_id='6b01296ddc8548168bdd5897f6107f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(566e62da-6dd8-4637-9b51-49dca7c7eed6),volume_type_id=566e62da-6dd8-4637-9b51-49dca7c7eed6)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Creating volume 9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:06 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:07 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf 1073741824 Jul 09 05:08:07 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Lock "cinder-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-quobyte-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:07 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.936s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfbb7fe-5c3c-4761-888f-09acb4db6221]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Deleted volume successfully. Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Flow 'volume_create_manager' (b0c3d8cb-545e-4f95-841b-c0a3446ceda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915dc87d-ee4d-410b-b3d8-e1b19b8f3b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b5764319-aec6-4f14-912b-d1e1f6d43525 tempest-VolumesGetTest-217374597 None] Lock "cinder-65b2d1bb-88f7-4eec-b245-191b3cf05c5b-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915dc87d-ee4d-410b-b3d8-e1b19b8f3b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-212653054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32daec89-83c4-4610-ad06-60300087be2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aada75edd9634537b651e54591880566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:07Z,use_quota=True,user_id='56709f66be074e0f98471a7e40b3b3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27ece5f-0161-43e7-8aaf-ec930df8ce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27ece5f-0161-43e7-8aaf-ec930df8ce1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8515e59-e11d-4aaa-906f-1bb9bf815fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8515e59-e11d-4aaa-906f-1bb9bf815fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32daec89-83c4-4610-ad06-60300087be2e', 'volume_name': 'volume-32daec89-83c4-4610-ad06-60300087be2e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cc0621-f09d-4732-b313-aeafad935dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cc0621-f09d-4732-b313-aeafad935dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:07 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a44825-0949-4618-b45a-bdf425ada85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:07 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:07 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Volume 32daec89-83c4-4610-ad06-60300087be2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32daec89-83c4-4610-ad06-60300087be2e', 'volume_size': 1} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Flow 'volume_create_manager' (c34cc1fb-2f7b-4ae9-ba4f-f4d4ebf04a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2407e5-dd22-43d3-b60a-07905e3a0c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2407e5-dd22-43d3-b60a-07905e3a0c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1234618601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb94ed9-61fd-43b3-adad-b87d5837bc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2930bc8661c430695d5ca5384af0def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:08Z,use_quota=True,user_id='6b01296ddc8548168bdd5897f6107f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(523bdb89-fa7f-484c-8187-16262d886a63),volume_type_id=523bdb89-fa7f-484c-8187-16262d886a63)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2678dcd-cfd2-4084-99e4-93b0075f854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2678dcd-cfd2-4084-99e4-93b0075f854c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c72b271-2f87-40bf-9656-2a0967aa1e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c72b271-2f87-40bf-9656-2a0967aa1e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb94ed9-61fd-43b3-adad-b87d5837bc1f', 'volume_name': 'volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186c835e-6432-4cdb-91f7-48a73e02ed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186c835e-6432-4cdb-91f7-48a73e02ed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d06bf6a-fc37-47f8-82da-7ce6f632d04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:07 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Volume dcb94ed9-61fd-43b3-adad-b87d5837bc1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f', 'volume_size': 1} Jul 09 05:08:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:08 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf 1073741824" returned: 0 in 1.053s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Flow 'volume_create_manager' (a0424814-9728-4e75-94a2-233a11055654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c92360-4645-4f57-898f-2add9e437945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:08 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf Jul 09 05:08:08 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c92360-4645-4f57-898f-2add9e437945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1395436762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2df04e0-cf1f-40c2-88ab-64203b7f2dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2930bc8661c430695d5ca5384af0def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:08Z,use_quota=True,user_id='6b01296ddc8548168bdd5897f6107f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8ac41de-84c7-4a3d-850e-6b51cb22192a),volume_type_id=e8ac41de-84c7-4a3d-850e-6b51cb22192a)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205b6543-8518-47e6-b782-b9d9bfe808a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205b6543-8518-47e6-b782-b9d9bfe808a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c8a532-b40b-4bb8-b6dc-64d75a0287b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.image.glance [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Creating Keystone auth plugin from conf {{(pid=87161) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 05:08:08 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4" returned: 0 in 1.074s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:08 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4 Jul 09 05:08:08 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c8a532-b40b-4bb8-b6dc-64d75a0287b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2df04e0-cf1f-40c2-88ab-64203b7f2dd1', 'volume_name': 'volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1', 'volume_size': 1, 'image_id': '4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1843296014', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c2930bc8661c430695d5ca5384af0def', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'created_at': datetime.datetime(2026, 7, 9, 3, 8, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 8, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f5fd775-4be9-4eb9-8d3b-f47f3061e0df/file', 'properties': {}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5fcabb-addc-4323-ba84-c0d59f03c7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5fcabb-addc-4323-ba84-c0d59f03c7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3ddc18-3952-46fe-97f2-7238c955a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:08 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Volume c2df04e0-cf1f-40c2-88ab-64203b7f2dd1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1', 'volume_size': 1, 'image_id': '4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1843296014', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c2930bc8661c430695d5ca5384af0def', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'created_at': datetime.datetime(2026, 7, 9, 3, 8, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 8, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f5fd775-4be9-4eb9-8d3b-f47f3061e0df/file', 'properties': {}}, 'image_service': } Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Trying to clone c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 from image 4f5fd775-4be9-4eb9-8d3b-f47f3061e0df at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'metadata': {}}]). {{(pid=87161) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 05:08:08 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf" returned: 0 in 0.772s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-212653054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32daec89-83c4-4610-ad06-60300087be2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aada75edd9634537b651e54591880566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:07Z,use_quota=True,user_id='56709f66be074e0f98471a7e40b3b3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Creating volume 32daec89-83c4-4610-ad06-60300087be2e {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:08 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:08 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e 1073741824 Jul 09 05:08:08 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9873bab9-0890-459b-89d4-8f21dd6bbdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2f90fe-56ca-4f4e-955c-784564f0d861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:08 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Volume volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf (9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf): created successfully Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2f90fe-56ca-4f4e-955c-784564f0d861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Flow 'volume_create_manager' (f215b3d7-196b-4b66-a7ff-d95f79c8ad27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a2e7a039-e0c6-421f-96cc-d5b213ade795 tempest-TestInstancesWithCinderVolumes-961223282 None] Created volume successfully. Jul 09 05:08:09 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4" returned: 0 in 0.756s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4" released by "delete_volume" :: held 1.947s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:09 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Created reservations ['802cccb6-9d0c-4c9f-a9c2-d05273de312c', '32e59595-042e-4061-a418-66f2e8de7887', '2c1e1fcb-31db-446b-a1f8-dceeef5d1945', 'bff5dbeb-b374-40ad-a280-f11bdcc8b40c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:08:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:09 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:09 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:10 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e 1073741824" returned: 0 in 1.166s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:10 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e Jul 09 05:08:10 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:10 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.946s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:10 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Deleted volume successfully. Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f013d274-029a-49b2-9547-a84dc79b6a4f tempest-VolumesGetTest-217374597 None] Lock "cinder-aa6f4b72-5cf5-49f6-bc1b-e6c4ee5560d4-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (8c9d97c4-042e-4026-8889-36125b4dc65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8744b8bf-2cd6-4a5f-b261-760db2b20996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8744b8bf-2cd6-4a5f-b261-760db2b20996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1392049137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2722bd4b-51dd-410c-bc02-b728290d7c5e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:11Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a080c8d-2ea6-4439-8ae8-a42c08bbc1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a080c8d-2ea6-4439-8ae8-a42c08bbc1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f9076c-9bb9-4a01-9ea4-0161063443cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.image.glance [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Creating Keystone auth plugin from conf {{(pid=87161) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f9076c-9bb9-4a01-9ea4-0161063443cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2722bd4b-51dd-410c-bc02-b728290d7c5e', 'volume_name': 'volume-2722bd4b-51dd-410c-bc02-b728290d7c5e', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194470ae-673c-47e8-9f8b-053169e4ccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194470ae-673c-47e8-9f8b-053169e4ccce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f31983-98f4-4b02-ae46-e3c651519983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:10 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Volume 2722bd4b-51dd-410c-bc02-b728290d7c5e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2722bd4b-51dd-410c-bc02-b728290d7c5e', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Trying to clone 2722bd4b-51dd-410c-bc02-b728290d7c5e from image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]). {{(pid=87161) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 05:08:10 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e" returned: 0 in 0.813s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.157s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1234618601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb94ed9-61fd-43b3-adad-b87d5837bc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2930bc8661c430695d5ca5384af0def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:08Z,use_quota=True,user_id='6b01296ddc8548168bdd5897f6107f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(523bdb89-fa7f-484c-8187-16262d886a63),volume_type_id=523bdb89-fa7f-484c-8187-16262d886a63)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Creating volume dcb94ed9-61fd-43b3-adad-b87d5837bc1f {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:10 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:10 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f 1073741824 Jul 09 05:08:10 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a44825-0949-4618-b45a-bdf425ada85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32daec89-83c4-4610-ad06-60300087be2e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e40250-12c5-4d22-a94f-5e9781fb1014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Volume volume-32daec89-83c4-4610-ad06-60300087be2e (32daec89-83c4-4610-ad06-60300087be2e): created successfully Jul 09 05:08:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e40250-12c5-4d22-a94f-5e9781fb1014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Flow 'volume_create_manager' (b0c3d8cb-545e-4f95-841b-c0a3446ceda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-02d169b7-f93d-494d-8146-92e3d552c9cc tempest-VolumesTestJSON-1970602894 None] Created volume successfully. Jul 09 05:08:11 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 05:08:11 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Image download 20.69 MB at 20.69 MB/s Jul 09 05:08:11 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[57025439-081d-4622-87f3-ca13e05eb65c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:11 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD Jul 09 05:08:11 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-4d90680b-09a5-4b01-9ac8-0cc6e64249f9 req-ccec4c2a-41db-4b19-9389-5eeec67c19c1 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Terminate volume connection completed successfully. Jul 09 05:08:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-4d90680b-09a5-4b01-9ac8-0cc6e64249f9 req-ccec4c2a-41db-4b19-9389-5eeec67c19c1 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Deleting attachment 1c51f07e-dacb-4420-b653-df354a586340. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:08:12 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD" returned: 0 in 0.910s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Temporary image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 is fetched for user 2dd2e5bbc2e74caa9aefff0c65d58b66. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 05:08:12 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f 1073741824" returned: 0 in 1.340s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Flow 'volume_create_manager' (d40c2c6d-1e55-42fd-9b94-39225d9e4c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd0380e-e14b-4a92-98f9-654f8a6a3595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:12 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f Jul 09 05:08:12 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd0380e-e14b-4a92-98f9-654f8a6a3595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-495618416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5f29e2-eefc-4d5e-a914-0b2dac2c0823,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aada75edd9634537b651e54591880566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:12Z,use_quota=True,user_id='56709f66be074e0f98471a7e40b3b3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c498d281-2b26-4d4c-9be3-6882db5bfafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c498d281-2b26-4d4c-9be3-6882db5bfafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b0d957-44e4-43fe-9d2a-bb2e8d950c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b0d957-44e4-43fe-9d2a-bb2e8d950c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a5f29e2-eefc-4d5e-a914-0b2dac2c0823', 'volume_name': 'volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec05ce1f-6148-4e76-bccb-f08b1f331088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec05ce1f-6148-4e76-bccb-f08b1f331088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803c74ae-9d7d-4278-b8cc-9d406aca32c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:12 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Volume 5a5f29e2-eefc-4d5e-a914-0b2dac2c0823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823', 'volume_size': 1} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1c1aad-679c-4200-af24-6ecfbc1ea868]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:12 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD Jul 09 05:08:12 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:13 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f" returned: 0 in 0.697s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-495618416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5f29e2-eefc-4d5e-a914-0b2dac2c0823,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aada75edd9634537b651e54591880566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:12Z,use_quota=True,user_id='56709f66be074e0f98471a7e40b3b3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Creating volume 5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:13 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:13 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 1073741824 Jul 09 05:08:13 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d06bf6a-fc37-47f8-82da-7ce6f632d04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f80693-ee2b-4098-bd72-9f786e88eded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:13 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Volume volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f (dcb94ed9-61fd-43b3-adad-b87d5837bc1f): created successfully Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f80693-ee2b-4098-bd72-9f786e88eded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Flow 'volume_create_manager' (c34cc1fb-2f7b-4ae9-ba4f-f4d4ebf04a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3377dd02-78dc-40cf-9b7d-7d71933fea37 tempest-TestInstancesWithCinderVolumes-961223282 None] Created volume successfully. Jul 09 05:08:13 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD, size 20.69 MB, duration 4.68 sec {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 05:08:13 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Image download 20.69 MB at 4.42 MB/s Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7420140-066b-445b-8c1f-b1651030eb2d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:13 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD Jul 09 05:08:13 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Acquiring lock "cinder-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "cinder-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Acquiring lock "cinder-quobyte-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "cinder-quobyte-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[792ad12f-e3da-4711-9b5d-0d7b5d9a9f51]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:13 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 Jul 09 05:08:13 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:14 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 1073741824" returned: 0 in 0.975s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:14 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 Jul 09 05:08:14 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:14 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD" returned: 0 in 0.835s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Temporary image 4f5fd775-4be9-4eb9-8d3b-f47f3061e0df is fetched for user 6b01296ddc8548168bdd5897f6107f0b. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c08157-f21d-46bb-9046-302d37be9bee]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:14 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD Jul 09 05:08:14 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:14 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6" returned: 0 in 0.843s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:14 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6 Jul 09 05:08:14 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:14 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823" returned: 0 in 0.726s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1392049137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2722bd4b-51dd-410c-bc02-b728290d7c5e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:11Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Creating volume 2722bd4b-51dd-410c-bc02-b728290d7c5e {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:14 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:14 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e 1073741824 Jul 09 05:08:14 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803c74ae-9d7d-4278-b8cc-9d406aca32c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cff5340-aeca-40d2-a45c-56df5a801481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:14 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Volume volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 (5a5f29e2-eefc-4d5e-a914-0b2dac2c0823): created successfully Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cff5340-aeca-40d2-a45c-56df5a801481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Flow 'volume_create_manager' (d40c2c6d-1e55-42fd-9b94-39225d9e4c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:14 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a84e8df8-980f-476b-8adc-2e9ddf6a51ae tempest-VolumesTestJSON-1970602894 None] Created volume successfully. Jul 09 05:08:15 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD" returned: 0 in 0.810s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:15 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6" returned: 0 in 0.723s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "cinder-quobyte-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6" released by "delete_volume" :: held 1.611s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Created reservations ['901d8874-ee37-4831-af81-1ab6ba3a822a', '3d5261d4-9e46-4756-8610-94b2a77c8a41', 'fe265e1b-84a4-4651-adaa-764d7598454b', '11135442-9276-4fbd-95ca-4f53c7270837'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:15 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:15 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:15 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e 1073741824" returned: 0 in 0.914s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:15 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e Jul 09 05:08:15 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:16 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.756s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Deleted volume successfully. Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-59558a17-3aaf-4ca7-8e1e-cc2cc6212014 tempest-TestServerVolumeAttachScenarioOldVersion-1050304558 None] Lock "cinder-eb5562f0-8ba0-4eb6-a2cb-71e5ffb253f6-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Acquiring lock "cinder-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Lock "cinder-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Acquiring lock "cinder-quobyte-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Lock "cinder-quobyte-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d960a4-ba53-4f74-958c-5698f14e56e5]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:16 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 Jul 09 05:08:16 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:16 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e" returned: 0 in 0.806s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.522s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1395436762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2df04e0-cf1f-40c2-88ab-64203b7f2dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2930bc8661c430695d5ca5384af0def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:08Z,use_quota=True,user_id='6b01296ddc8548168bdd5897f6107f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8ac41de-84c7-4a3d-850e-6b51cb22192a),volume_type_id=e8ac41de-84c7-4a3d-850e-6b51cb22192a)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Creating volume c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:16 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:16 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 1073741824 Jul 09 05:08:16 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Attempting download of dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}])) to volume 2722bd4b-51dd-410c-bc02-b728290d7c5e. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdefa26-74ea-4898-99e6-5f9155ade219]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_iiagj4jd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:16 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_iiagj4jd Jul 09 05:08:16 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:17 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823" returned: 0 in 0.835s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:17 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823 Jul 09 05:08:17 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:17 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_iiagj4jd" returned: 0 in 0.824s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_iiagj4jd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:17 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 1073741824" returned: 0 in 0.949s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:17 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 Jul 09 05:08:17 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:17 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_iiagj4jd Jul 09 05:08:17 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:18 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823" returned: 0 in 0.932s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Lock "cinder-quobyte-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823" released by "delete_volume" :: held 1.822s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Created reservations ['895dfe4b-a6e4-432b-ab82-4a041938517b', '163a4052-d22b-4632-b225-b72c0a9f7c2d', '6bf3d263-85bd-4dd3-9fdc-3344dd043664', 'e6a42a8b-5acf-43d1-a5ae-25b99d3bcd25'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:18 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:18 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:18 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_iiagj4jd" returned: 1 in 1.019s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_iiagj4jd' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d7c179-86c5-4495-b528-8d6377ae2bed]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Acquiring lock "cinder-32daec89-83c4-4610-ad06-60300087be2e-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:18 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" returned: 0 in 1.079s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Lock "cinder-32daec89-83c4-4610-ad06-60300087be2e-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:18 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD Jul 09 05:08:18 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:18 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Attempting download of 4f5fd775-4be9-4eb9-8d3b-f47f3061e0df ((None, [{'url': 'file:///opt/stack/data/glance/images/4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'metadata': {}}])) to volume c2df04e0-cf1f-40c2-88ab-64203b7f2dd1. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Acquiring lock "cinder-quobyte-32daec89-83c4-4610-ad06-60300087be2e" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Lock "cinder-quobyte-32daec89-83c4-4610-ad06-60300087be2e" acquired by "delete_volume" :: waited 0.032s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[15613e73-0219-4a48-be7f-91d237d92e4f]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_th87gut4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c78662-531e-486b-83e2-d5e18ae9f058]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:19 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e Jul 09 05:08:19 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:19 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_th87gut4 Jul 09 05:08:19 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:19 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.902s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Deleted volume successfully. Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-68def16b-8c77-4811-ad60-286887c9b943 tempest-VolumesTestJSON-1970602894 None] Lock "cinder-5a5f29e2-eefc-4d5e-a914-0b2dac2c0823-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:19 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD" returned: 0 in 1.229s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 was qcow2, converting to raw {{(pid=87161) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 05:08:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:19 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e Jul 09 05:08:19 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:20 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e" returned: 0 in 1.164s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:20 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_th87gut4" returned: 0 in 1.247s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_th87gut4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:20 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e Jul 09 05:08:20 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:20 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_th87gut4 Jul 09 05:08:20 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:21 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-32daec89-83c4-4610-ad06-60300087be2e" returned: 0 in 0.742s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Lock "cinder-quobyte-32daec89-83c4-4610-ad06-60300087be2e" released by "delete_volume" :: held 1.997s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Created reservations ['107d5b3b-25c9-4ac8-abf5-2f54d10d2135', 'f82f7789-b53e-4079-b4fb-b3ae72d2e031', 'f8cc4b69-b08a-443b-adb0-2a57db98f0f0', '49c85597-e2a6-4225-952b-8e6ea20af55b'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:08:21 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_th87gut4" returned: 1 in 0.893s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_th87gut4' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b070b4f-a4c4-46e7-ac4b-116396aca647]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:21 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:21 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:21 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD Jul 09 05:08:21 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:22 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] 4f5fd775-4be9-4eb9-8d3b-f47f3061e0df was qcow2, converting to raw {{(pid=87161) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:22 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.817s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:22 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Deleted volume successfully. Jul 09 05:08:22 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 Jul 09 05:08:22 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a0c7677-4e61-4b9f-bc45-6907a670f9f5 tempest-VolumesTestJSON-1970602894 None] Lock "cinder-32daec89-83c4-4610-ad06-60300087be2e-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:22 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e" returned: 0 in 2.305s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6keuw43cdevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:08:22 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Converted 112.00 MB image at 48.57 MB/s Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:22 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e 1G Jul 09 05:08:22 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Acquiring lock "cinder-01a2e0b8-647d-455d-9945-9a01bac5d14f-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Lock "cinder-01a2e0b8-647d-455d-9945-9a01bac5d14f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Acquiring lock "cinder-quobyte-01a2e0b8-647d-455d-9945-9a01bac5d14f" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Lock "cinder-quobyte-01a2e0b8-647d-455d-9945-9a01bac5d14f" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d50952e-1d9a-4d73-9a62-d77bd7dc1dae]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:22 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f Jul 09 05:08:22 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:22 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e 1G" returned: 0 in 0.805s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:23 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a19cfe-ea30-4937-b623-f58977ae00b1]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:23 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e Jul 09 05:08:23 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:23 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f" returned: 0 in 0.860s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:23 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f Jul 09 05:08:23 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:23 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e" returned: 0 in 0.880s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:24 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e Jul 09 05:08:24 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:24 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" returned: 0 in 2.061s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f5fd775-4be9-4eb9-8d3b-f47f3061e0df_iprkokzjdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:08:24 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Converted 112.00 MB image at 54.31 MB/s Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:24 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 1G Jul 09 05:08:24 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:24 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-01a2e0b8-647d-455d-9945-9a01bac5d14f" returned: 0 in 0.926s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Lock "cinder-quobyte-01a2e0b8-647d-455d-9945-9a01bac5d14f" released by "delete_volume" :: held 1.850s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Created reservations ['5d97395c-0ec9-4eb5-aade-b3a8384df581', 'b8d53853-d3ee-4995-b719-e3bdc0734a5c', '972145ab-129c-4855-a473-f4b27208b355', 'b64fb95a-7b2e-47dd-b27d-7072c0ff6cf7'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:24 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:24 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:24 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e" returned: 1 in 0.943s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Downloaded image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}])) to volume 2722bd4b-51dd-410c-bc02-b728290d7c5e successfully. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Temporary image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 for user 2dd2e5bbc2e74caa9aefff0c65d58b66 is deleted. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Marking volume 2722bd4b-51dd-410c-bc02-b728290d7c5e as bootable. {{(pid=87161) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Copying metadata from image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 to 2722bd4b-51dd-410c-bc02-b728290d7c5e. {{(pid=87161) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 05:08:24 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Creating volume glance metadata for volume 2722bd4b-51dd-410c-bc02-b728290d7c5e backed by image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87161) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 05:08:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f31983-98f4-4b02-ae46-e3c651519983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2722bd4b-51dd-410c-bc02-b728290d7c5e', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48fbcff-8112-4e6a-b407-747cd653cc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:25 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Volume volume-2722bd4b-51dd-410c-bc02-b728290d7c5e (2722bd4b-51dd-410c-bc02-b728290d7c5e): created successfully Jul 09 05:08:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48fbcff-8112-4e6a-b407-747cd653cc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (8c9d97c4-042e-4026-8889-36125b4dc65c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:25 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7ff577b0-5789-40c7-aa1d-7c0e1c46a5b7 tempest-VolumesGetTest-217374597 None] Created volume successfully. Jul 09 05:08:25 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 1G" returned: 0 in 1.070s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:25 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fb8842-733c-466a-b400-945a56ccb28d]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:25 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.968s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:25 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:25 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Deleted volume successfully. Jul 09 05:08:25 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 Jul 09 05:08:25 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1b516039-0666-4748-961f-db3b1b97b22c tempest-VolumesTestJSON-1970602894 None] Lock "cinder-01a2e0b8-647d-455d-9945-9a01bac5d14f-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:26 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" returned: 0 in 0.932s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:26 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 Jul 09 05:08:26 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (975f6686-ec92-47aa-bab9-7d0a7ad4bf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be10625-b0e6-4ee6-bac3-1251feb2ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be10625-b0e6-4ee6-bac3-1251feb2ff58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-978137921',display_name='tempest-VolumesGetTest-Volume-1716016260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0263e3ad-0fee-4560-b248-999c5d95134d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:27Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99872696-3d9d-45ea-af4c-48c8d4567b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99872696-3d9d-45ea-af4c-48c8d4567b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a42e4f-7a10-41aa-ac84-a14321f1c7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a42e4f-7a10-41aa-ac84-a14321f1c7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0263e3ad-0fee-4560-b248-999c5d95134d', 'volume_name': 'volume-0263e3ad-0fee-4560-b248-999c5d95134d', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daef4d7-857e-460f-8d87-7d7e8793b679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daef4d7-857e-460f-8d87-7d7e8793b679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb41ec2-6d17-4385-bbfd-fba0a760a339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:26 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Volume 0263e3ad-0fee-4560-b248-999c5d95134d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0263e3ad-0fee-4560-b248-999c5d95134d', 'volume_size': 1} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-978137921',display_name='tempest-VolumesGetTest-Volume-1716016260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0263e3ad-0fee-4560-b248-999c5d95134d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9c7b5100e44f68557b1cf7e3bf43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:27Z,use_quota=True,user_id='2dd2e5bbc2e74caa9aefff0c65d58b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Creating volume 0263e3ad-0fee-4560-b248-999c5d95134d {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:26 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:26 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d 1073741824 Jul 09 05:08:26 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:27 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" returned: 1 in 1.020s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Downloaded image 4f5fd775-4be9-4eb9-8d3b-f47f3061e0df ((None, [{'url': 'file:///opt/stack/data/glance/images/4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'metadata': {}}])) to volume c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 successfully. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Temporary image 4f5fd775-4be9-4eb9-8d3b-f47f3061e0df for user 6b01296ddc8548168bdd5897f6107f0b is deleted. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Marking volume c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 as bootable. {{(pid=87161) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Copying metadata from image 4f5fd775-4be9-4eb9-8d3b-f47f3061e0df to c2df04e0-cf1f-40c2-88ab-64203b7f2dd1. {{(pid=87161) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Creating volume glance metadata for volume c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 backed by image 4f5fd775-4be9-4eb9-8d3b-f47f3061e0df with: {'image_id': '4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'image_name': 'tempest-scenario-img--1843296014', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87161) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3ddc18-3952-46fe-97f2-7238c955a604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1', 'volume_size': 1, 'image_id': '4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1843296014', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c2930bc8661c430695d5ca5384af0def', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f5fd775-4be9-4eb9-8d3b-f47f3061e0df', 'created_at': datetime.datetime(2026, 7, 9, 3, 8, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 8, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f5fd775-4be9-4eb9-8d3b-f47f3061e0df/file', 'properties': {}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa15f153-516f-41d7-8860-0e0ecc416f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:27 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Volume volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 (c2df04e0-cf1f-40c2-88ab-64203b7f2dd1): created successfully Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa15f153-516f-41d7-8860-0e0ecc416f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Flow 'volume_create_manager' (a0424814-9728-4e75-94a2-233a11055654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:27 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3f234563-8078-4574-ad6b-9c5b1f382a97 tempest-TestInstancesWithCinderVolumes-961223282 None] Created volume successfully. Jul 09 05:08:27 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d 1073741824" returned: 0 in 0.982s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:27 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d Jul 09 05:08:27 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:28 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d" returned: 0 in 0.877s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb41ec2-6d17-4385-bbfd-fba0a760a339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0263e3ad-0fee-4560-b248-999c5d95134d', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9ce03b-b32c-4fdc-802e-5490246a1fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:28 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Volume volume-0263e3ad-0fee-4560-b248-999c5d95134d (0263e3ad-0fee-4560-b248-999c5d95134d): created successfully Jul 09 05:08:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9ce03b-b32c-4fdc-802e-5490246a1fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Flow 'volume_create_manager' (975f6686-ec92-47aa-bab9-7d0a7ad4bf5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c7d46b41-25e0-41c6-a6ae-554b87702173 tempest-VolumesGetTest-217374597 None] Created volume successfully. Jul 09 05:08:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-db802193-aa3b-4c49-8db5-e052ff41cca2 tempest-GroupsV320Test-1563815107 None] Group tempest-GroupsV320Test-Group-746492215: creating Jul 09 05:08:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-db802193-aa3b-4c49-8db5-e052ff41cca2 tempest-GroupsV320Test-1563815107 None] Group tempest-GroupsV320Test-Group-746492215: created successfully Jul 09 05:08:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-db802193-aa3b-4c49-8db5-e052ff41cca2 tempest-GroupsV320Test-1563815107 None] Create group completed successfully. Jul 09 05:08:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-0263e3ad-0fee-4560-b248-999c5d95134d-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Lock "cinder-0263e3ad-0fee-4560-b248-999c5d95134d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-quobyte-0263e3ad-0fee-4560-b248-999c5d95134d" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-0263e3ad-0fee-4560-b248-999c5d95134d" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:30 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ddbf5c-8239-44fc-aba6-5f21c8de4202]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:30 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d Jul 09 05:08:30 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-7fbb111c-b549-46f8-9b0c-7d9317642a49 tempest-GroupsV320Test-1563815107 None] Created reservations ['69a89afc-33c5-46c3-abac-9793fa3fc8a4'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7fbb111c-b549-46f8-9b0c-7d9317642a49 tempest-GroupsV320Test-1563815107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7fbb111c-b549-46f8-9b0c-7d9317642a49 tempest-GroupsV320Test-1563815107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb111c-b549-46f8-9b0c-7d9317642a49 tempest-GroupsV320Test-1563815107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb111c-b549-46f8-9b0c-7d9317642a49 tempest-GroupsV320Test-1563815107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7fbb111c-b549-46f8-9b0c-7d9317642a49 tempest-GroupsV320Test-1563815107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7fbb111c-b549-46f8-9b0c-7d9317642a49 tempest-GroupsV320Test-1563815107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:31 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:31 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:31 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d" returned: 0 in 0.882s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:31 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d Jul 09 05:08:31 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:31 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7fbb111c-b549-46f8-9b0c-7d9317642a49 tempest-GroupsV320Test-1563815107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.779s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-7fbb111c-b549-46f8-9b0c-7d9317642a49 tempest-GroupsV320Test-1563815107 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7fbb111c-b549-46f8-9b0c-7d9317642a49 tempest-GroupsV320Test-1563815107 None] Delete group completed successfully. Jul 09 05:08:31 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0263e3ad-0fee-4560-b248-999c5d95134d" returned: 0 in 0.752s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-0263e3ad-0fee-4560-b248-999c5d95134d" released by "delete_volume" :: held 1.687s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Created reservations ['19f8c321-b408-470b-804c-68b802c3039e', '308e4e5b-f597-4599-9aec-551c3bbaedc1', 'd0900c72-a374-4779-970f-ce530a31914f', '5348d1c0-038f-41af-b336-386add2cbcfa'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:32 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:32 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-2722bd4b-51dd-410c-bc02-b728290d7c5e-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Lock "cinder-2722bd4b-51dd-410c-bc02-b728290d7c5e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Acquiring lock "cinder-quobyte-2722bd4b-51dd-410c-bc02-b728290d7c5e" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-2722bd4b-51dd-410c-bc02-b728290d7c5e" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bd4efd-2966-42d6-b09b-eab5e38da4ed]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:32 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e Jul 09 05:08:32 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:33 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.934s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:33 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Deleted volume successfully. Jul 09 05:08:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c7c95b29-1636-4b20-8eb2-1befeda13430 tempest-VolumesGetTest-217374597 None] Lock "cinder-0263e3ad-0fee-4560-b248-999c5d95134d-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:33 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e" returned: 0 in 1.048s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:33 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e Jul 09 05:08:33 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:34 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e" returned: 1 in 1.046s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:08:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:34 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e Jul 09 05:08:34 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ee73be64-e2b6-4f0a-88ed-0efca1d41c5f req-bbcce08f-95a3-47ea-84e3-b048278ae6ae tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ee73be64-e2b6-4f0a-88ed-0efca1d41c5f req-bbcce08f-95a3-47ea-84e3-b048278ae6ae tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:35 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2722bd4b-51dd-410c-bc02-b728290d7c5e" returned: 0 in 0.996s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Lock "cinder-quobyte-2722bd4b-51dd-410c-bc02-b728290d7c5e" released by "delete_volume" :: held 3.203s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:35 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[79717793-c1d8-4afc-b913-bc4d688b6bc4]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ee73be64-e2b6-4f0a-88ed-0efca1d41c5f req-bbcce08f-95a3-47ea-84e3-b048278ae6ae tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:36 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Created reservations ['98bb4430-5f5e-4455-9c2f-93c36765d009', '1a306608-b27c-4f4d-b816-d7deba54db30', '52d2c887-3cc4-4b04-9b18-bc80a12722bc', '9596229a-c800-4fee-8877-62402b4ba917'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:08:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:36 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:36 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:36 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 Jul 09 05:08:36 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:37 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.938s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:37 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:37 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Deleted volume successfully. Jul 09 05:08:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a2d5fd3-7df1-4b9d-9342-4bb96d05c5b6 tempest-VolumesGetTest-217374597 None] Lock "cinder-2722bd4b-51dd-410c-bc02-b728290d7c5e-delete_volume" released by "delete_volume" :: held 4.498s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:08:37 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ee73be64-e2b6-4f0a-88ed-0efca1d41c5f req-bbcce08f-95a3-47ea-84e3-b048278ae6ae tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" returned: 0 in 1.479s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ee73be64-e2b6-4f0a-88ed-0efca1d41c5f req-bbcce08f-95a3-47ea-84e3-b048278ae6ae tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:37 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 Jul 09 05:08:37 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:38 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ee73be64-e2b6-4f0a-88ed-0efca1d41c5f req-bbcce08f-95a3-47ea-84e3-b048278ae6ae tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" returned: 1 in 0.983s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ee73be64-e2b6-4f0a-88ed-0efca1d41c5f req-bbcce08f-95a3-47ea-84e3-b048278ae6ae tempest-TestInstancesWithCinderVolumes-961223282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:08:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ee73be64-e2b6-4f0a-88ed-0efca1d41c5f req-bbcce08f-95a3-47ea-84e3-b048278ae6ae tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.545s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-ee73be64-e2b6-4f0a-88ed-0efca1d41c5f req-bbcce08f-95a3-47ea-84e3-b048278ae6ae tempest-TestInstancesWithCinderVolumes-961223282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4931c85-bce7-4997-9a81-522a65b542cb', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:08:38 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-ee73be64-e2b6-4f0a-88ed-0efca1d41c5f req-bbcce08f-95a3-47ea-84e3-b048278ae6ae tempest-TestInstancesWithCinderVolumes-961223282 None] attachment_update completed successfully. Jul 09 05:08:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:08:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:39 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:08:39 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:40 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Flow 'volume_create_manager' (d0eb8e93-5637-4135-9668-e7cf6ae5c4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d01352b-2338-405f-9991-6dbb27fc23b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.015s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d01352b-2338-405f-9991-6dbb27fc23b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1202329463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b773be89-7c16-4f98-a7d6-2122141bceb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac49d205674468e8c50e2dc28f96a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:40Z,use_quota=True,user_id='204f34c298784f5ca84a5d4415cf0eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e8fd12-1f2d-41bb-ae1b-3e36ffd776f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e8fd12-1f2d-41bb-ae1b-3e36ffd776f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2302f9f9-a615-4468-bdbc-1d367cc88495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2302f9f9-a615-4468-bdbc-1d367cc88495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b773be89-7c16-4f98-a7d6-2122141bceb2', 'volume_name': 'volume-b773be89-7c16-4f98-a7d6-2122141bceb2', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c07c56d-6224-4da5-ba0a-314bc47a83aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c07c56d-6224-4da5-ba0a-314bc47a83aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b6a4e0-d137-42ae-b1f7-6d4b6656ca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:40 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Volume b773be89-7c16-4f98-a7d6-2122141bceb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b773be89-7c16-4f98-a7d6-2122141bceb2', 'volume_size': 1} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1202329463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b773be89-7c16-4f98-a7d6-2122141bceb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac49d205674468e8c50e2dc28f96a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:40Z,use_quota=True,user_id='204f34c298784f5ca84a5d4415cf0eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Creating volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:40 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:40 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 1073741824 Jul 09 05:08:40 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Flow 'volume_create_manager' (9df9b7a6-aa62-435a-8b14-716d16de07d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c96b2ac-81e8-4f91-907b-19503e08d952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c96b2ac-81e8-4f91-907b-19503e08d952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb60bac-7396-43d9-adf7-96a6b5af7702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e7734fc9cb4b0c9c062580a9e2b0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:40Z,use_quota=True,user_id='1a98e1488bbb4c8a9897f8ca418412b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f821553-8a48-4239-83d6-0663d98a9e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f821553-8a48-4239-83d6-0663d98a9e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5170ffe8-dd54-4af6-b4ce-735bfc634988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5170ffe8-dd54-4af6-b4ce-735bfc634988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb60bac-7396-43d9-adf7-96a6b5af7702', 'volume_name': 'volume-cfb60bac-7396-43d9-adf7-96a6b5af7702', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df06c8e6-2499-4aec-852b-9c33a514094a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df06c8e6-2499-4aec-852b-9c33a514094a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145fed18-4d7c-420a-90f6-a7c701d0fca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:40 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Volume cfb60bac-7396-43d9-adf7-96a6b5af7702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb60bac-7396-43d9-adf7-96a6b5af7702', 'volume_size': 1} Jul 09 05:08:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:41 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 1073741824" returned: 0 in 0.999s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:41 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 Jul 09 05:08:41 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:41 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2" returned: 0 in 0.700s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb60bac-7396-43d9-adf7-96a6b5af7702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e7734fc9cb4b0c9c062580a9e2b0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:40Z,use_quota=True,user_id='1a98e1488bbb4c8a9897f8ca418412b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Creating volume cfb60bac-7396-43d9-adf7-96a6b5af7702 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:41 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b6a4e0-d137-42ae-b1f7-6d4b6656ca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b773be89-7c16-4f98-a7d6-2122141bceb2', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:41 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702 1073741824 Jul 09 05:08:41 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee46f6c8-0723-40b6-b49c-1be0aec119cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Volume volume-b773be89-7c16-4f98-a7d6-2122141bceb2 (b773be89-7c16-4f98-a7d6-2122141bceb2): created successfully Jul 09 05:08:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee46f6c8-0723-40b6-b49c-1be0aec119cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Flow 'volume_create_manager' (d0eb8e93-5637-4135-9668-e7cf6ae5c4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:42 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b3dc31ab-37f9-41cd-a608-da885f43f9c7 tempest-SnapshotsActionsTest-1706374528 None] Created volume successfully. Jul 09 05:08:43 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702 1073741824" returned: 0 in 1.229s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:43 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702 Jul 09 05:08:43 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:43 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702" returned: 0 in 0.709s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.647s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145fed18-4d7c-420a-90f6-a7c701d0fca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb60bac-7396-43d9-adf7-96a6b5af7702', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6242a7-d600-4b59-80f2-79fa67edba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Creating offline snapshot d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 of volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:08:43 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Volume volume-cfb60bac-7396-43d9-adf7-96a6b5af7702 (cfb60bac-7396-43d9-adf7-96a6b5af7702): created successfully Jul 09 05:08:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6242a7-d600-4b59-80f2-79fa67edba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Flow 'volume_create_manager' (9df9b7a6-aa62-435a-8b14-716d16de07d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:44 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce2e912-22df-42a0-a012-d8614f568968]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:44 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-20a25587-f883-4012-b18a-c7a24e66556c tempest-CinderUnicodeTest-1379849054 None] Created volume successfully. Jul 09 05:08:44 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 Jul 09 05:08:44 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:44 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Flow 'volume_create_manager' (6ed16d8f-7b5a-4fbd-9c3f-b5a45f2c21a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a46c2d-57a3-4473-8fb8-5d954ef21bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a46c2d-57a3-4473-8fb8-5d954ef21bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1232244725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3debc485-8c70-477c-ac01-435ee8905612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e7734fc9cb4b0c9c062580a9e2b0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:45Z,use_quota=True,user_id='1a98e1488bbb4c8a9897f8ca418412b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8184adc-4a00-4143-a5c3-df573899ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8184adc-4a00-4143-a5c3-df573899ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5fde02-b444-4072-accc-09dd522d3160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5fde02-b444-4072-accc-09dd522d3160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3debc485-8c70-477c-ac01-435ee8905612', 'volume_name': 'volume-3debc485-8c70-477c-ac01-435ee8905612', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1386aeba-dd1d-4c7c-898d-79382010dfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1386aeba-dd1d-4c7c-898d-79382010dfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3d04cc-c8ef-4d28-9f02-713091069387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:45 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Volume 3debc485-8c70-477c-ac01-435ee8905612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3debc485-8c70-477c-ac01-435ee8905612', 'volume_size': 1} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:45 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2" returned: 0 in 1.221s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:45 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 1G Jul 09 05:08:45 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:46 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 1G" returned: 0 in 1.208s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:46 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:08:46 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:47 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 1.174s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:47 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 is being set with open permissions: ugo+rw Jul 09 05:08:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:47 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:08:47 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:48 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 1.098s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:48 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=130,cinder:SELECT=106,cinder:INSERT=41,cinder:DELETE=12 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:08:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:48 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.info Jul 09 05:08:48 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:49 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.info" returned: 0 in 1.142s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:49 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.info is being set with open permissions: ugo+rw Jul 09 05:08:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:49 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.info Jul 09 05:08:50 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:51 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.info" returned: 0 in 1.091s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.123s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:08:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1232244725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3debc485-8c70-477c-ac01-435ee8905612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e7734fc9cb4b0c9c062580a9e2b0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:08:45Z,use_quota=True,user_id='1a98e1488bbb4c8a9897f8ca418412b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Creating volume 3debc485-8c70-477c-ac01-435ee8905612 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:08:51 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:08:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:51 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 1073741824 Jul 09 05:08:51 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-71e2e97c-8a43-43c4-baaa-5aeaadcb7d3d tempest-SnapshotsActionsTest-1706374528 None] Create snapshot completed successfully Jul 09 05:08:52 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 1073741824" returned: 0 in 1.494s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:52 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 Jul 09 05:08:52 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:53 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612" returned: 0 in 0.956s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] <== create_volume: return (2531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.540s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.496s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3d04cc-c8ef-4d28-9f02-713091069387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3debc485-8c70-477c-ac01-435ee8905612', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e9c369-35f6-4fe0-98f3-22db24cc78db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] Creating offline snapshot 2cac4a93-9261-4ed1-a325-ba0a4dd5e170 of volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:08:53 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Volume volume-3debc485-8c70-477c-ac01-435ee8905612 (3debc485-8c70-477c-ac01-435ee8905612): created successfully Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e9c369-35f6-4fe0-98f3-22db24cc78db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Flow 'volume_create_manager' (6ed16d8f-7b5a-4fbd-9c3f-b5a45f2c21a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2bf54b-2e1f-442a-8e69-b3eb8427c727]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:53 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b5e50c3f-9d4d-44ae-b353-74a8ab131b47 tempest-CinderUnicodeTest-1379849054 None] Created volume successfully. Jul 09 05:08:53 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:08:53 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:54 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:DELETE=14,cinder:SELECT=119,cinder:UPDATE=140,cinder:INSERT=38 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:08:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:08:55 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 1.460s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:08:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:55 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 1G Jul 09 05:08:55 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:56 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 1G" returned: 0 in 1.413s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:56 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 Jul 09 05:08:56 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:57 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170" returned: 0 in 0.835s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:57 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 is being set with open permissions: ugo+rw Jul 09 05:08:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:57 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 Jul 09 05:08:57 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:58 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170" returned: 0 in 0.742s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.669s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:08:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.570s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:08:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Creating offline snapshot b295fa91-4296-409b-90be-8c0815b32e19 of volume 3debc485-8c70-477c-ac01-435ee8905612 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:08:58 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b3624-8a54-4d2c-9837-5ee21e301ad5]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ff84fc71-8210-41c3-9c09-33d5cbd51ea7 tempest-SnapshotsActionsTest-1706374528 None] Create snapshot completed successfully Jul 09 05:08:58 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 Jul 09 05:08:58 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:59 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612" returned: 0 in 0.923s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:59 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 1G Jul 09 05:08:59 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-2cac4a93-9261-4ed1-a325-ba0a4dd5e170-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-2cac4a93-9261-4ed1-a325-ba0a4dd5e170-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-quobyte-2cac4a93-9261-4ed1-a325-ba0a4dd5e170" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-2cac4a93-9261-4ed1-a325-ba0a4dd5e170" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Deleting offline snapshot 2cac4a93-9261-4ed1-a325-ba0a4dd5e170 of volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] snapshot_file for this snap is: volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1731f669-d460-4562-9502-173763c55fb5]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:08:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:08:59 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 Jul 09 05:08:59 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:00 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 1G" returned: 0 in 1.091s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3debc485-8c70-477c-ac01-435ee8905612 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:00 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3debc485-8c70-477c-ac01-435ee8905612 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 Jul 09 05:09:00 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:00 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170" returned: 0 in 0.985s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:00 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9de9c9-46a3-43f5-97b1-ed99e585ef77]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:00 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:09:00 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:01 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3debc485-8c70-477c-ac01-435ee8905612 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19" returned: 0 in 1.048s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:01 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 is being set with open permissions: ugo+rw Jul 09 05:09:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:01 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 Jul 09 05:09:01 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:01 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 0.918s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:01 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 Jul 09 05:09:01 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:02 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19" returned: 0 in 0.781s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:02 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.info Jul 09 05:09:02 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:02 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170" returned: 0 in 0.850s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:02 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170 Jul 09 05:09:02 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:02 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.info" returned: 0 in 0.690s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:02 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.info is being set with open permissions: ugo+rw Jul 09 05:09:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:02 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.info Jul 09 05:09:02 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:03 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.2cac4a93-9261-4ed1-a325-ba0a4dd5e170" returned: 0 in 0.842s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-2cac4a93-9261-4ed1-a325-ba0a4dd5e170" released by "_delete_snapshot" :: held 3.775s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" released by "delete_snapshot" :: held 3.819s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:03 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Created reservations ['37bda1f2-6687-460f-9a62-9bf58bf07ddb', '7f40b40f-529f-4f6a-bbb6-e422eefcbd7b', 'f7b6e4f4-8f53-441e-bb06-c9ffba6661f2', 'a07186c1-0689-44e5-8371-096e5ec4d7a1'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Delete snapshot completed successfully. Jul 09 05:09:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b08f28d0-fb07-4de7-87c2-93f00b269b5f tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-2cac4a93-9261-4ed1-a325-ba0a4dd5e170-delete_snapshot" released by "delete_snapshot" :: held 4.056s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:03 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.info" returned: 0 in 0.983s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.643s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7767b22b-9316-4759-a9be-2698fc92d75d tempest-CinderUnicodeTest-1379849054 None] Create snapshot completed successfully Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] Creating offline snapshot 18260e44-98e6-43c6-b95d-db8d5e4d3426 of volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dd340c-0f83-4e39-9680-13cc1bc7deeb]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "cinder-b295fa91-4296-409b-90be-8c0815b32e19-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-b295fa91-4296-409b-90be-8c0815b32e19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "cinder-quobyte-3debc485-8c70-477c-ac01-435ee8905612" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-quobyte-3debc485-8c70-477c-ac01-435ee8905612" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "cinder-quobyte-b295fa91-4296-409b-90be-8c0815b32e19" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-quobyte-b295fa91-4296-409b-90be-8c0815b32e19" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Deleting offline snapshot b295fa91-4296-409b-90be-8c0815b32e19 of volume 3debc485-8c70-477c-ac01-435ee8905612 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] snapshot_file for this snap is: volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8747075c-9598-4c8c-b829-790b35381522]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:04 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:09:04 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:04 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 Jul 09 05:09:04 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:05 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 0.864s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:05 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 1G Jul 09 05:09:05 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:05 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19" returned: 0 in 0.857s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3debc485-8c70-477c-ac01-435ee8905612(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:05 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[171c4b00-3afb-4387-8fd1-2774d88b4d51]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:05 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 Jul 09 05:09:05 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:06 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 1G" returned: 0 in 1.010s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:06 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 Jul 09 05:09:06 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:06 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612" returned: 0 in 0.918s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:06 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 Jul 09 05:09:06 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:06 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426" returned: 0 in 0.751s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:06 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 is being set with open permissions: ugo+rw Jul 09 05:09:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:06 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 Jul 09 05:09:06 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:06 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19" returned: 0 in 0.744s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:06 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19 Jul 09 05:09:07 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:07 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426" returned: 0 in 0.692s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.463s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:07 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612.b295fa91-4296-409b-90be-8c0815b32e19" returned: 0 in 0.675s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-bef22e6c-456b-4eb2-86ac-998f9f824bf3 tempest-SnapshotsActionsTest-1706374528 None] Create snapshot completed successfully Jul 09 05:09:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-quobyte-b295fa91-4296-409b-90be-8c0815b32e19" released by "_delete_snapshot" :: held 3.345s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-quobyte-3debc485-8c70-477c-ac01-435ee8905612" released by "delete_snapshot" :: held 3.380s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:07 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Created reservations ['96fed218-ed97-4618-9547-c2641ba2ba5b', 'c8da565a-7a0f-4b1b-ba7c-178c86f4e9fa', 'e5e6dd4c-ac9f-45e3-8299-9859a9f16443', '5f952dcd-304e-482b-b9e6-5745c2ac4a8e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Delete snapshot completed successfully. Jul 09 05:09:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-42f16620-4353-4af0-9cc7-789fab1fff06 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-b295fa91-4296-409b-90be-8c0815b32e19-delete_snapshot" released by "delete_snapshot" :: held 3.540s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-18260e44-98e6-43c6-b95d-db8d5e4d3426-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-18260e44-98e6-43c6-b95d-db8d5e4d3426-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-quobyte-18260e44-98e6-43c6-b95d-db8d5e4d3426" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-18260e44-98e6-43c6-b95d-db8d5e4d3426" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Deleting offline snapshot 18260e44-98e6-43c6-b95d-db8d5e4d3426 of volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] snapshot_file for this snap is: volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "cinder-3debc485-8c70-477c-ac01-435ee8905612-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6c6622-c725-445f-99a4-ef74a5071f52]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-3debc485-8c70-477c-ac01-435ee8905612-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "cinder-quobyte-3debc485-8c70-477c-ac01-435ee8905612" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-quobyte-3debc485-8c70-477c-ac01-435ee8905612" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31f30e8-449a-4103-bff4-1a4eb783d411]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:08 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 Jul 09 05:09:08 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:08 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 Jul 09 05:09:08 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:09 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426" returned: 0 in 0.836s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:09 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f060f0a-65db-431c-8c07-b2c2d12669ed]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:09 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:09:09 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:09 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612" returned: 0 in 1.078s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:09 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612 Jul 09 05:09:09 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:10 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 0.974s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:10 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 Jul 09 05:09:10 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:10 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3debc485-8c70-477c-ac01-435ee8905612" returned: 0 in 0.948s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-quobyte-3debc485-8c70-477c-ac01-435ee8905612" released by "delete_volume" :: held 2.093s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Created reservations ['dda61088-2975-496a-b3c0-877d6b038f82', '198c8d4f-be16-4937-8d6d-b597d11b4bad', '08224162-453c-4d4c-accf-8bab261a39ed', '688766aa-f5ef-41bc-9418-1d6d58d6315c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:10 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:09:10 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Flow 'volume_create_manager' (10a6e4ac-7c15-4e19-a74f-c8b24537c33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c1cbb1-76da-4c0a-8b75-8092078bad2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c1cbb1-76da-4c0a-8b75-8092078bad2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1764061291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9402b49b-8b78-41f6-ac1c-40f2408078fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918e7cefde8c4c80b6bf03bccc56eb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:11Z,use_quota=True,user_id='7b9329d61cbd4308bdccb180a3a50071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8750598c-4aed-43dc-8244-513006f844c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8750598c-4aed-43dc-8244-513006f844c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bf2702-0793-405b-bbee-df51146c248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bf2702-0793-405b-bbee-df51146c248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9402b49b-8b78-41f6-ac1c-40f2408078fb', 'volume_name': 'volume-9402b49b-8b78-41f6-ac1c-40f2408078fb', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337a82d8-8a79-4fdd-b403-8f055e82f348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337a82d8-8a79-4fdd-b403-8f055e82f348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d51faa-ec28-48a9-a2e9-5a277df96c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Volume 9402b49b-8b78-41f6-ac1c-40f2408078fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9402b49b-8b78-41f6-ac1c-40f2408078fb', 'volume_size': 1} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1764061291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9402b49b-8b78-41f6-ac1c-40f2408078fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918e7cefde8c4c80b6bf03bccc56eb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:11Z,use_quota=True,user_id='7b9329d61cbd4308bdccb180a3a50071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Creating volume 9402b49b-8b78-41f6-ac1c-40f2408078fb {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:09:11 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:09:11 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426" returned: 0 in 0.985s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:11 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb 1073741824 Jul 09 05:09:11 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:11 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426 Jul 09 05:09:11 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Flow 'volume_create_manager' (44df116c-2228-469a-b850-99affd06eba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5a12ef-cad4-4cfa-855f-9ac54989100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5a12ef-cad4-4cfa-855f-9ac54989100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-534368755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311e2c44-0895-4e4f-8c1e-ee6a96658c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918e7cefde8c4c80b6bf03bccc56eb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:12Z,use_quota=True,user_id='7b9329d61cbd4308bdccb180a3a50071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab8c9f7-16b6-489a-a9c1-c9f1beaffd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab8c9f7-16b6-489a-a9c1-c9f1beaffd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2db9657-935f-486f-9fcc-b8cc54946253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2db9657-935f-486f-9fcc-b8cc54946253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311e2c44-0895-4e4f-8c1e-ee6a96658c31', 'volume_name': 'volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5867d1-77a9-437d-b9e4-b49f88254b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5867d1-77a9-437d-b9e4-b49f88254b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296eef7f-379e-4c1d-afc0-77cb162608ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Volume 311e2c44-0895-4e4f-8c1e-ee6a96658c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31', 'volume_size': 1} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:11 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.031s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:11 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:09:12 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Deleted volume successfully. Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-69cf327d-76e4-4029-b8dc-c9d10242dad6 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-3debc485-8c70-477c-ac01-435ee8905612-delete_volume" released by "delete_volume" :: held 3.416s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "cinder-cfb60bac-7396-43d9-adf7-96a6b5af7702-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-cfb60bac-7396-43d9-adf7-96a6b5af7702-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "cinder-quobyte-cfb60bac-7396-43d9-adf7-96a6b5af7702" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-quobyte-cfb60bac-7396-43d9-adf7-96a6b5af7702" acquired by "delete_volume" :: waited 0.031s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d77d296-e585-49c7-ac08-59a8cda81df6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:12 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.18260e44-98e6-43c6-b95d-db8d5e4d3426" returned: 0 in 1.107s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:12 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702 Jul 09 05:09:12 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-18260e44-98e6-43c6-b95d-db8d5e4d3426" released by "_delete_snapshot" :: held 4.050s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" released by "delete_snapshot" :: held 4.076s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Created reservations ['d83b6e6a-0864-4cda-965b-6b13c55ba8cf', '187dc51a-74d2-4c34-9bdb-c9c7a223a547', '7514e76a-18ef-41e0-9c49-20f1fab690e3', '723d1bd5-72a8-4593-916c-4e6014f5de6c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:12 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Delete snapshot completed successfully. Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-511d9ae1-c600-4b7c-8372-46c8ea158c1e tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-18260e44-98e6-43c6-b95d-db8d5e4d3426-delete_snapshot" released by "delete_snapshot" :: held 4.250s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:12 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb 1073741824" returned: 0 in 1.446s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:12 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb Jul 09 05:09:12 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:13 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702" returned: 0 in 1.012s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:13 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702 Jul 09 05:09:13 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:13 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb" returned: 0 in 0.757s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.278s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.752s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-534368755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311e2c44-0895-4e4f-8c1e-ee6a96658c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918e7cefde8c4c80b6bf03bccc56eb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:12Z,use_quota=True,user_id='7b9329d61cbd4308bdccb180a3a50071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Creating volume 311e2c44-0895-4e4f-8c1e-ee6a96658c31 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:09:13 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d51faa-ec28-48a9-a2e9-5a277df96c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9402b49b-8b78-41f6-ac1c-40f2408078fb', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:13 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 1073741824 Jul 09 05:09:13 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4649dd5f-43ba-4c18-8a06-6beaf3c9b899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:13 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Volume volume-9402b49b-8b78-41f6-ac1c-40f2408078fb (9402b49b-8b78-41f6-ac1c-40f2408078fb): created successfully Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4649dd5f-43ba-4c18-8a06-6beaf3c9b899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Flow 'volume_create_manager' (10a6e4ac-7c15-4e19-a74f-c8b24537c33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-cc881cb1-c5b8-47ae-a6fc-cf0226f79aa6 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Created volume successfully. Jul 09 05:09:14 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cfb60bac-7396-43d9-adf7-96a6b5af7702" returned: 0 in 0.687s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-quobyte-cfb60bac-7396-43d9-adf7-96a6b5af7702" released by "delete_volume" :: held 1.783s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Created reservations ['fc415664-27b2-49ec-864e-8bf76053ee9a', 'f713943b-5b87-4bf4-95d7-d2013f8f731f', '2c74963a-2f18-4745-a769-dc784285c63d', '6d665661-6ac1-4db2-a9c7-30f906bc0e8a'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:14 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:09:14 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:14 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 1073741824" returned: 0 in 0.908s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:14 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 Jul 09 05:09:14 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:14 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.734s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:09:15 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Deleted volume successfully. Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2f87268-5802-4120-b026-819c25bcdd26 tempest-CinderUnicodeTest-1379849054 None] Lock "cinder-cfb60bac-7396-43d9-adf7-96a6b5af7702-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:15 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31" returned: 0 in 0.812s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.236s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] Creating offline snapshot 008aaa4b-213a-4633-9b02-cb4d9e05ccb1 of volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296eef7f-379e-4c1d-afc0-77cb162608ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5892f9-3f1f-45e9-bb7a-fddd397ec67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9231fbd5-1ac0-47e2-8052-416d4878ba6a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:15 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Volume volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 (311e2c44-0895-4e4f-8c1e-ee6a96658c31): created successfully Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5892f9-3f1f-45e9-bb7a-fddd397ec67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Flow 'volume_create_manager' (44df116c-2228-469a-b850-99affd06eba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:15 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4e437d7c-12e1-4492-acaa-b78b1735f09a tempest-TestServerVolumeAttachmentScenario-1525917369 None] Created volume successfully. Jul 09 05:09:15 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:09:15 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:16 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 0.971s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:16 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 1G Jul 09 05:09:16 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:17 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 1G" returned: 0 in 0.940s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:17 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 Jul 09 05:09:17 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:18 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1" returned: 0 in 0.717s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:18 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 is being set with open permissions: ugo+rw Jul 09 05:09:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:18 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 Jul 09 05:09:18 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:18 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1" returned: 0 in 0.679s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.481s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-fe3b6618-524b-419d-98e1-7b61d4fbbc49 tempest-SnapshotsActionsTest-1706374528 None] Create snapshot completed successfully Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-d17412c3-a95b-42c5-86de-7163c9a31def req-13e48c81-c94b-450d-b5f2-cd44b7221762 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-d17412c3-a95b-42c5-86de-7163c9a31def req-13e48c81-c94b-450d-b5f2-cd44b7221762 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605eca0-96b8-492b-b20c-7de7d25878d6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-d17412c3-a95b-42c5-86de-7163c9a31def req-13e48c81-c94b-450d-b5f2-cd44b7221762 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:19 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf Jul 09 05:09:19 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-008aaa4b-213a-4633-9b02-cb4d9e05ccb1-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-008aaa4b-213a-4633-9b02-cb4d9e05ccb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-quobyte-008aaa4b-213a-4633-9b02-cb4d9e05ccb1" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-008aaa4b-213a-4633-9b02-cb4d9e05ccb1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Deleting offline snapshot 008aaa4b-213a-4633-9b02-cb4d9e05ccb1 of volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] snapshot_file for this snap is: volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56f4403-413f-4ff2-ae86-901025da11f9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:19 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 Jul 09 05:09:19 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:20 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-d17412c3-a95b-42c5-86de-7163c9a31def req-13e48c81-c94b-450d-b5f2-cd44b7221762 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf" returned: 0 in 0.881s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-d17412c3-a95b-42c5-86de-7163c9a31def req-13e48c81-c94b-450d-b5f2-cd44b7221762 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.905s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-d17412c3-a95b-42c5-86de-7163c9a31def req-13e48c81-c94b-450d-b5f2-cd44b7221762 tempest-TestInstancesWithCinderVolumes-961223282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bf72939-6357-44ab-8bae-4d2e398be05a', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:09:20 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-d17412c3-a95b-42c5-86de-7163c9a31def req-13e48c81-c94b-450d-b5f2-cd44b7221762 tempest-TestInstancesWithCinderVolumes-961223282 None] attachment_update completed successfully. Jul 09 05:09:20 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1" returned: 0 in 1.060s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:20 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be1beb3-2574-43c6-b862-927b7b74f75a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:21 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:09:21 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:22 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 1.142s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:22 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 Jul 09 05:09:22 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:23 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1" returned: 0 in 0.963s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:23 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1 Jul 09 05:09:23 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:23 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.008aaa4b-213a-4633-9b02-cb4d9e05ccb1" returned: 0 in 0.722s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-008aaa4b-213a-4633-9b02-cb4d9e05ccb1" released by "_delete_snapshot" :: held 4.030s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" released by "delete_snapshot" :: held 4.061s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:23 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Created reservations ['f0d98c57-028d-4d05-8141-09e062fd0927', '165ab0d2-7941-482f-b7c0-cd80f9319dd0', 'c0af8196-a160-4c7e-9d6c-ca2ab3351add', '9520af40-f2d1-46a8-855d-d464f9881021'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:23 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Delete snapshot completed successfully. Jul 09 05:09:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cecaa632-6be0-4c2d-bbde-c0a9798d4df4 tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-008aaa4b-213a-4633-9b02-cb4d9e05ccb1-delete_snapshot" released by "delete_snapshot" :: held 4.246s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Flow 'volume_create_manager' (a0786a80-5a1d-4063-b7f5-35bb45da210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee78577-66e5-4124-81de-8818b1de62ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee78577-66e5-4124-81de-8818b1de62ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192923513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae015a13-021a-451b-ae57-ac8a0813baf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07ea90efc6541708545f732940b9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:24Z,use_quota=True,user_id='51d24f68787a473a91acb092ea7c78f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c0fda8-e0b4-4673-9308-e4712c9a36e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c0fda8-e0b4-4673-9308-e4712c9a36e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff29b955-5c8a-458d-897e-d4a6bd14cff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff29b955-5c8a-458d-897e-d4a6bd14cff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae015a13-021a-451b-ae57-ac8a0813baf3', 'volume_name': 'volume-ae015a13-021a-451b-ae57-ac8a0813baf3', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ef0570-f9fc-470e-9c0d-e1b965dde9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ef0570-f9fc-470e-9c0d-e1b965dde9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628eedb6-ddec-417c-81e7-e3b2039c51b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:24 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Volume ae015a13-021a-451b-ae57-ac8a0813baf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae015a13-021a-451b-ae57-ac8a0813baf3', 'volume_size': 1} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192923513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae015a13-021a-451b-ae57-ac8a0813baf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07ea90efc6541708545f732940b9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:24Z,use_quota=True,user_id='51d24f68787a473a91acb092ea7c78f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Creating volume ae015a13-021a-451b-ae57-ac8a0813baf3 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:09:24 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:24 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3 1073741824 Jul 09 05:09:24 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:25 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3 1073741824" returned: 0 in 0.874s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:25 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3 Jul 09 05:09:25 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:25 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3" returned: 0 in 0.648s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.304s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] Creating offline snapshot 0c87c07e-9b49-478b-bf94-e722154a5800 of volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628eedb6-ddec-417c-81e7-e3b2039c51b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae015a13-021a-451b-ae57-ac8a0813baf3', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0adf2ba-f907-4bfb-9929-bad841cccbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02c26c5-8af1-489c-8ce8-7a61475cc844]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:25 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Volume volume-ae015a13-021a-451b-ae57-ac8a0813baf3 (ae015a13-021a-451b-ae57-ac8a0813baf3): created successfully Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0adf2ba-f907-4bfb-9929-bad841cccbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Flow 'volume_create_manager' (a0786a80-5a1d-4063-b7f5-35bb45da210b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:25 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d97d1c66-60b3-4181-bb35-b44ef147d9d4 tempest-ProjectReaderTests-1281623808 None] Created volume successfully. Jul 09 05:09:26 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:09:26 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "cinder-ae015a13-021a-451b-ae57-ac8a0813baf3-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-ae015a13-021a-451b-ae57-ac8a0813baf3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "cinder-quobyte-ae015a13-021a-451b-ae57-ac8a0813baf3" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-quobyte-ae015a13-021a-451b-ae57-ac8a0813baf3" acquired by "delete_volume" :: waited 0.046s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:26 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6df46a-91e1-4090-9ec3-0db93450369e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:26 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3 Jul 09 05:09:26 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:26 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 1.023s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:26 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 1G Jul 09 05:09:26 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:27 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3" returned: 0 in 1.049s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:27 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3 Jul 09 05:09:27 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:27 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 1G" returned: 0 in 1.018s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:27 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 Jul 09 05:09:27 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:28 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae015a13-021a-451b-ae57-ac8a0813baf3" returned: 0 in 0.709s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-quobyte-ae015a13-021a-451b-ae57-ac8a0813baf3" released by "delete_volume" :: held 1.861s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:28 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Created reservations ['adfb0d6c-4a95-411d-9507-d22a55d0d46a', 'ef1800e2-594e-4741-835d-3f95a8cc18a7', 'd07d425e-452e-4a32-8270-9fb6c6be863d', 'b062408f-d4fb-43ac-a97c-5d2876c2771c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:28 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:09:28 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:29 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800" returned: 0 in 1.101s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:29 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 is being set with open permissions: ugo+rw Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:29 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 Jul 09 05:09:29 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:29 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.789s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:09:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Deleted volume successfully. Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-aa202c77-2c5f-49e1-bb01-02f5a6249c14 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-ae015a13-021a-451b-ae57-ac8a0813baf3-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-15bc5fd3-8641-493e-87bb-f603667a1eb9 req-3ed5ac08-6cc6-41e4-8be7-b808c8c27375 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Flow 'volume_create_manager' (126f801d-4e32-45ae-b7bc-a7ca104fa120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a7d6ff-a41f-4ceb-936b-7d1c6d989c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a7d6ff-a41f-4ceb-936b-7d1c6d989c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127146041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d288a88-5a7a-40ac-8ba5-a4376b6a0404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07ea90efc6541708545f732940b9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:30Z,use_quota=True,user_id='51d24f68787a473a91acb092ea7c78f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01234374-9013-4be4-90de-5d2553e28297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01234374-9013-4be4-90de-5d2553e28297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b3553-561d-4bc7-b770-0c05a907f2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b3553-561d-4bc7-b770-0c05a907f2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d288a88-5a7a-40ac-8ba5-a4376b6a0404', 'volume_name': 'volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874e75f7-6449-443e-9588-839a90012a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874e75f7-6449-443e-9588-839a90012a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a06b2b1-adb3-4aae-a65d-89805e06e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:29 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Volume 2d288a88-5a7a-40ac-8ba5-a4376b6a0404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404', 'volume_size': 1} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:29 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800" returned: 0 in 0.894s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-15bc5fd3-8641-493e-87bb-f603667a1eb9 req-3ed5ac08-6cc6-41e4-8be7-b808c8c27375 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.539s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1f7f12-abc2-4201-8a0f-c6a2abdf8736]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-15bc5fd3-8641-493e-87bb-f603667a1eb9 req-3ed5ac08-6cc6-41e4-8be7-b808c8c27375 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:30 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-22c07ab7-102b-483e-9ab5-1120d0fa2ac5 tempest-SnapshotsActionsTest-1706374528 None] Create snapshot completed successfully Jul 09 05:09:30 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f Jul 09 05:09:30 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:30 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-15bc5fd3-8641-493e-87bb-f603667a1eb9 req-3ed5ac08-6cc6-41e4-8be7-b808c8c27375 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f" returned: 0 in 0.862s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-15bc5fd3-8641-493e-87bb-f603667a1eb9 req-3ed5ac08-6cc6-41e4-8be7-b808c8c27375 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.890s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127146041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d288a88-5a7a-40ac-8ba5-a4376b6a0404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07ea90efc6541708545f732940b9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:30Z,use_quota=True,user_id='51d24f68787a473a91acb092ea7c78f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Creating volume 2d288a88-5a7a-40ac-8ba5-a4376b6a0404 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:09:30 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-0c87c07e-9b49-478b-bf94-e722154a5800-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:30 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404 1073741824 Jul 09 05:09:30 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-0c87c07e-9b49-478b-bf94-e722154a5800-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Acquiring lock "cinder-quobyte-0c87c07e-9b49-478b-bf94-e722154a5800" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-15bc5fd3-8641-493e-87bb-f603667a1eb9 req-3ed5ac08-6cc6-41e4-8be7-b808c8c27375 tempest-TestInstancesWithCinderVolumes-961223282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '684da7e9-3953-4406-8ef4-e6a375c5967d', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:09:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-0c87c07e-9b49-478b-bf94-e722154a5800" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Deleting offline snapshot 0c87c07e-9b49-478b-bf94-e722154a5800 of volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:09:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] snapshot_file for this snap is: volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:09:31 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5e8f4c-75ee-4d47-9874-f9998b0209d5]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-15bc5fd3-8641-493e-87bb-f603667a1eb9 req-3ed5ac08-6cc6-41e4-8be7-b808c8c27375 tempest-TestInstancesWithCinderVolumes-961223282 None] attachment_update completed successfully. Jul 09 05:09:31 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 Jul 09 05:09:31 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:32 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800" returned: 0 in 1.001s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a88e5b2-92a9-4b67-9cbf-539a914ec70f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:32 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404 1073741824" returned: 0 in 1.347s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:32 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404 Jul 09 05:09:32 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:32 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:09:32 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:33 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404" returned: 0 in 0.824s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a06b2b1-adb3-4aae-a65d-89805e06e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f283b1fd-a6cf-45a0-a461-fe62296bf151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:33 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Volume volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404 (2d288a88-5a7a-40ac-8ba5-a4376b6a0404): created successfully Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f283b1fd-a6cf-45a0-a461-fe62296bf151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Flow 'volume_create_manager' (126f801d-4e32-45ae-b7bc-a7ca104fa120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-25173398-7392-4d29-b447-06c8762aa39a tempest-ProjectReaderTests-1281623808 None] Created volume successfully. Jul 09 05:09:33 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 1.083s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:33 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 Jul 09 05:09:33 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "cinder-2d288a88-5a7a-40ac-8ba5-a4376b6a0404-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-2d288a88-5a7a-40ac-8ba5-a4376b6a0404-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "cinder-quobyte-2d288a88-5a7a-40ac-8ba5-a4376b6a0404" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-quobyte-2d288a88-5a7a-40ac-8ba5-a4376b6a0404" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:34 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[841e8a24-9ad5-4d3c-8015-8a327723a907]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:34 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800" returned: 0 in 0.998s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:34 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800 Jul 09 05:09:34 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:34 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404 Jul 09 05:09:34 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:35 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.0c87c07e-9b49-478b-bf94-e722154a5800" returned: 0 in 0.760s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:35 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404" returned: 0 in 0.816s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-0c87c07e-9b49-478b-bf94-e722154a5800" released by "_delete_snapshot" :: held 4.034s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" released by "delete_snapshot" :: held 4.100s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:35 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404 Jul 09 05:09:35 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Created reservations ['b4765d0b-dd01-4c2f-afeb-c9fce8574a78', 'b66015d4-9e46-46ba-a8a9-ca6a2145304f', '24527ede-86a5-4296-b7dd-dcf0d9e8ddac', '5d01a06a-3399-4b2e-83b7-1cca9cf6b79d'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:35 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Delete snapshot completed successfully. Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0cb3ea03-d536-4752-bc30-57076f067baf tempest-SnapshotsActionsTest-995523946 None] Lock "cinder-0c87c07e-9b49-478b-bf94-e722154a5800-delete_snapshot" released by "delete_snapshot" :: held 4.351s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:35 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2d288a88-5a7a-40ac-8ba5-a4376b6a0404" returned: 0 in 0.759s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-quobyte-2d288a88-5a7a-40ac-8ba5-a4376b6a0404" released by "delete_volume" :: held 1.638s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Created reservations ['a5a8d205-f4af-4ab2-9067-c421270bc942', '89abf4d5-cb29-41b4-a6a2-5702613010c2', '563733dd-5595-4d93-a92a-aee7910fdb3a', '167769f0-0663-4166-813a-8481d1110348'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:35 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:09:35 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:36 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.950s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:36 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:09:36 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Deleted volume successfully. Jul 09 05:09:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9740db3d-8e24-4956-b225-f40fa3db5bb7 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-2d288a88-5a7a-40ac-8ba5-a4376b6a0404-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "cinder-d2afbaf3-6265-4ae8-8cb9-c7535aec21a2-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Lock "cinder-d2afbaf3-6265-4ae8-8cb9-c7535aec21a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "cinder-quobyte-d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Lock "cinder-quobyte-d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Deleting offline snapshot d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 of volume b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] snapshot_file for this snap is: volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf025274-ce6c-43e5-81d0-ab3eaf41b3e1]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Flow 'volume_create_manager' (dd5372ef-37d9-4ff0-8cd7-503590c71eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7005211f-6a4f-4776-aac7-3f428c95b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:37 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7005211f-6a4f-4776-aac7-3f428c95b840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2136293639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ae41f0-8619-4565-b482-defdf6667cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07ea90efc6541708545f732940b9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:37Z,use_quota=True,user_id='51d24f68787a473a91acb092ea7c78f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:37 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1157499f-5f33-45fc-8906-990c0a98cbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1157499f-5f33-45fc-8906-990c0a98cbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4facfd9f-ec7b-4832-bdf3-fcd1dc49b46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4facfd9f-ec7b-4832-bdf3-fcd1dc49b46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ae41f0-8619-4565-b482-defdf6667cea', 'volume_name': 'volume-a3ae41f0-8619-4565-b482-defdf6667cea', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b441479f-206f-4f0a-b362-7e94c11096ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b441479f-206f-4f0a-b362-7e94c11096ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede259e3-68fe-4eb5-949e-84c6dd9d4068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:37 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Volume a3ae41f0-8619-4565-b482-defdf6667cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ae41f0-8619-4565-b482-defdf6667cea', 'volume_size': 1} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2136293639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ae41f0-8619-4565-b482-defdf6667cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07ea90efc6541708545f732940b9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:37Z,use_quota=True,user_id='51d24f68787a473a91acb092ea7c78f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Creating volume a3ae41f0-8619-4565-b482-defdf6667cea {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:09:37 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:09:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:37 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea 1073741824 Jul 09 05:09:37 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:38 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 0.907s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b773be89-7c16-4f98-a7d6-2122141bceb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:09:38 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[44938ebf-1bcb-4761-85e9-806c329b18e5]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:38 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 Jul 09 05:09:38 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:38 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea 1073741824" returned: 0 in 1.087s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:38 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea Jul 09 05:09:38 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:39 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2" returned: 0 in 0.998s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:39 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:09:39 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:39 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:09:39 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:39 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea" returned: 0 in 0.885s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede259e3-68fe-4eb5-949e-84c6dd9d4068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ae41f0-8619-4565-b482-defdf6667cea', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2181ee1-2306-44cc-bc9b-882ac76309f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:39 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Volume volume-a3ae41f0-8619-4565-b482-defdf6667cea (a3ae41f0-8619-4565-b482-defdf6667cea): created successfully Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2181ee1-2306-44cc-bc9b-882ac76309f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Flow 'volume_create_manager' (dd5372ef-37d9-4ff0-8cd7-503590c71eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:39 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-742aa6df-3f8c-441a-bcac-5fd39ef1310a tempest-ProjectReaderTests-1281623808 None] Created volume successfully. Jul 09 05:09:39 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.874s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:09:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:09:40 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 1.011s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:40 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2 Jul 09 05:09:40 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "cinder-a3ae41f0-8619-4565-b482-defdf6667cea-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-a3ae41f0-8619-4565-b482-defdf6667cea-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "cinder-quobyte-a3ae41f0-8619-4565-b482-defdf6667cea" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-quobyte-a3ae41f0-8619-4565-b482-defdf6667cea" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd3a013-55fe-4885-a90d-7e7495551f47]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:40 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea Jul 09 05:09:40 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:40 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2.d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" returned: 0 in 0.721s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Lock "cinder-quobyte-d2afbaf3-6265-4ae8-8cb9-c7535aec21a2" released by "_delete_snapshot" :: held 3.791s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" released by "delete_snapshot" :: held 3.819s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:41 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-75853943-34ba-4339-b6ea-aeb2f539963b req-7b7449ec-3bbb-4883-975c-ce08578053cc tempest-TestInstancesWithCinderVolumes-961223282 None] Terminate volume connection completed successfully. Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-75853943-34ba-4339-b6ea-aeb2f539963b req-7b7449ec-3bbb-4883-975c-ce08578053cc tempest-TestInstancesWithCinderVolumes-961223282 None] Deleting attachment 7bf72939-6357-44ab-8bae-4d2e398be05a. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Created reservations ['75bc24d6-27e6-4ff0-9dd4-8696ba76a382', '01638b5a-d516-405a-ab71-f7bcddceced6', '90cced7e-3893-4685-924f-5378736f7623', '59ee165c-c4c9-43e7-82ee-14a6e1e95750'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:41 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Delete snapshot completed successfully. Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e6ab92f-5c89-45b4-b230-39d6fd7a4073 tempest-SnapshotsActionsTest-1706374528 None] Lock "cinder-d2afbaf3-6265-4ae8-8cb9-c7535aec21a2-delete_snapshot" released by "delete_snapshot" :: held 4.005s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "cinder-b773be89-7c16-4f98-a7d6-2122141bceb2-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Lock "cinder-b773be89-7c16-4f98-a7d6-2122141bceb2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:41 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea" returned: 0 in 1.005s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[469a2772-123f-44a5-a1fc-adb3891b4b94]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:41 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea Jul 09 05:09:41 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:41 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 Jul 09 05:09:41 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:42 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a3ae41f0-8619-4565-b482-defdf6667cea" returned: 0 in 0.763s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-quobyte-a3ae41f0-8619-4565-b482-defdf6667cea" released by "delete_volume" :: held 1.821s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Created reservations ['5be2f265-bf65-46ae-849f-7881b770d641', '9b577c1b-d5f9-4095-b674-dd046ff9f8f5', 'e3f0e190-9104-4898-9499-2bee4b5b559f', 'dee3dfaa-fac1-4806-bf8a-a741e64a680c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:42 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2" returned: 0 in 0.821s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:42 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2 Jul 09 05:09:42 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:42 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:09:42 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "cinder-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "cinder-quobyte-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:43 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b773be89-7c16-4f98-a7d6-2122141bceb2" returned: 0 in 0.712s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-quobyte-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf" acquired by "delete_volume" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Lock "cinder-quobyte-b773be89-7c16-4f98-a7d6-2122141bceb2" released by "delete_volume" :: held 1.657s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcfd971-b05f-4c83-b150-103a8f80de3e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Created reservations ['9a921442-0df3-4db8-9272-d48b51dba5eb', 'a8e2adce-a665-4f22-8247-70566b0f5f62', '4fa6b57d-6ef7-489d-8ba9-4ad6058f1aff', '6760457d-acd0-4865-b585-b3dabcff7f41'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:09:43 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf Jul 09 05:09:43 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:43 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Flow 'volume_create_manager' (9ba35f2f-d34b-4d91-9967-83e2b214f9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d1d3a5-c415-40c5-8629-3e6d8cc95122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.920s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:09:43 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:09:43 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d1d3a5-c415-40c5-8629-3e6d8cc95122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-690732916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c70dc1-9930-40df-9295-3ebbf2798319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07ea90efc6541708545f732940b9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:43Z,use_quota=True,user_id='51d24f68787a473a91acb092ea7c78f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb222d1f-6d87-4f82-8816-f1dbc47baca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb222d1f-6d87-4f82-8816-f1dbc47baca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e170385-27df-41f3-b635-b067502e7387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e170385-27df-41f3-b635-b067502e7387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c70dc1-9930-40df-9295-3ebbf2798319', 'volume_name': 'volume-d9c70dc1-9930-40df-9295-3ebbf2798319', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a0bf36-51dc-458b-887b-5bf55533cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a0bf36-51dc-458b-887b-5bf55533cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056c108c-f9d1-432b-8f28-b455ccccbef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:43 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Volume d9c70dc1-9930-40df-9295-3ebbf2798319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c70dc1-9930-40df-9295-3ebbf2798319', 'volume_size': 1} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-690732916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c70dc1-9930-40df-9295-3ebbf2798319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07ea90efc6541708545f732940b9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:09:43Z,use_quota=True,user_id='51d24f68787a473a91acb092ea7c78f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Creating volume d9c70dc1-9930-40df-9295-3ebbf2798319 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:09:43 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:43 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Deleted volume successfully. Jul 09 05:09:43 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319 1073741824 Jul 09 05:09:43 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-748a7f9a-2054-4b40-9a6f-977904a8f538 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-a3ae41f0-8619-4565-b482-defdf6667cea-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:44 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.785s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:44 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:09:44 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Deleted volume successfully. Jul 09 05:09:44 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf" returned: 0 in 1.065s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-693d1d8b-0b32-4bee-aa26-e8d252a22050 tempest-SnapshotsActionsTest-1706374528 None] Lock "cinder-b773be89-7c16-4f98-a7d6-2122141bceb2-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:44 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf Jul 09 05:09:44 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:44 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319 1073741824" returned: 0 in 1.198s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:44 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319 Jul 09 05:09:44 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:45 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf" returned: 0 in 0.853s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-quobyte-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf" released by "delete_volume" :: held 1.990s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:45 devstack cinder-volume[87161]: WARNING cinder.quota [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-13091469-933941749 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-13091469-933941749, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:09:45 devstack cinder-volume[87161]: WARNING cinder.quota [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-13091469-933941749 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-13091469-933941749, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Created reservations ['4320ab92-14f5-4792-858a-2e50149bae78', '07ec9ffc-868d-487e-8aa2-939e7a1f2888', 'f6318ada-0ab0-4da3-be9f-355fca501cd7', 'adad4ead-f8c0-47f9-ab2d-ac274b12281c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:45 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:09:45 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:45 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319" returned: 0 in 0.851s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056c108c-f9d1-432b-8f28-b455ccccbef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c70dc1-9930-40df-9295-3ebbf2798319', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a905c0-c44f-4abb-943a-33fe67886898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:09:45 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Volume volume-d9c70dc1-9930-40df-9295-3ebbf2798319 (d9c70dc1-9930-40df-9295-3ebbf2798319): created successfully Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a905c0-c44f-4abb-943a-33fe67886898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:09:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Flow 'volume_create_manager' (9ba35f2f-d34b-4d91-9967-83e2b214f9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:09:45 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6fa3730c-c0a4-484e-a74d-3ba1440f395c tempest-ProjectReaderTests-1281623808 None] Created volume successfully. Jul 09 05:09:46 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.841s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:46 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:09:46 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Deleted volume successfully. Jul 09 05:09:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5c507331-8f05-42da-b339-00cf51df02be tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-9a2b48b4-bc6e-48a1-9eed-5e68fac54ebf-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "cinder-d9c70dc1-9930-40df-9295-3ebbf2798319-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-d9c70dc1-9930-40df-9295-3ebbf2798319-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "cinder-quobyte-d9c70dc1-9930-40df-9295-3ebbf2798319" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-quobyte-d9c70dc1-9930-40df-9295-3ebbf2798319" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:46 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbff20e-c101-4d78-9378-3c2c2c29c5af]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:46 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319 Jul 09 05:09:46 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:47 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319" returned: 0 in 0.818s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:47 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319 Jul 09 05:09:47 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:48 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d9c70dc1-9930-40df-9295-3ebbf2798319" returned: 0 in 0.648s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-quobyte-d9c70dc1-9930-40df-9295-3ebbf2798319" released by "delete_volume" :: held 1.519s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:48 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Created reservations ['92b370b9-67fa-4f7e-ac1a-4e3acac1d08c', 'c653403a-6a3d-4491-b292-02cdc56bd201', '6017c8a5-6841-41d7-97df-8f8b3d8227bd', 'ecec449b-4ac2-4787-a0a9-93fa3d2bb0d2'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:48 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-e3027633-1b35-4579-b4da-b6d29d5a23c4 req-23ad49b3-f0ae-4419-b044-9df92e0b8b4c tempest-TestInstancesWithCinderVolumes-961223282 None] Terminate volume connection completed successfully. Jul 09 05:09:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-e3027633-1b35-4579-b4da-b6d29d5a23c4 req-23ad49b3-f0ae-4419-b044-9df92e0b8b4c tempest-TestInstancesWithCinderVolumes-961223282 None] Deleting attachment 684da7e9-3953-4406-8ef4-e6a375c5967d. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:09:48 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:09:48 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:49 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.671s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:49 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:09:49 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Deleted volume successfully. Jul 09 05:09:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e34c0039-2874-4752-826c-9a2eec196182 tempest-ProjectReaderTests-1281623808 None] Lock "cinder-d9c70dc1-9930-40df-9295-3ebbf2798319-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "cinder-dcb94ed9-61fd-43b3-adad-b87d5837bc1f-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-dcb94ed9-61fd-43b3-adad-b87d5837bc1f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:50 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=119,cinder:SELECT=109,cinder:DELETE=9,cinder:INSERT=35 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:09:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "cinder-quobyte-dcb94ed9-61fd-43b3-adad-b87d5837bc1f" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:09:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-quobyte-dcb94ed9-61fd-43b3-adad-b87d5837bc1f" acquired by "delete_volume" :: waited 0.040s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:09:50 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb50ff2c-3c98-4911-b502-d9616cb35ed3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:50 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f Jul 09 05:09:50 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:52 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f" returned: 0 in 1.535s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:52 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f Jul 09 05:09:52 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:53 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-dcb94ed9-61fd-43b3-adad-b87d5837bc1f" returned: 0 in 1.016s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-quobyte-dcb94ed9-61fd-43b3-adad-b87d5837bc1f" released by "delete_volume" :: held 2.621s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:53 devstack cinder-volume[87161]: WARNING cinder.quota [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960849943-1219126752 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960849943-1219126752, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:09:53 devstack cinder-volume[87161]: WARNING cinder.quota [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960849943-1219126752 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960849943-1219126752, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:09:53 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Created reservations ['9034f639-2a51-4fc7-a87c-db1bf374c0ea', '50383f68-1802-4243-8138-fcabe2607a78', '9474d293-bd3e-405c-b7e0-dac7dba6b3c9', '2d928b88-a736-484e-a455-3f79c1839849'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:09:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:09:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:09:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:53 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:09:53 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:54 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:54 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:09:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Deleted volume successfully. Jul 09 05:09:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a5407a5c-9222-4ec1-bda7-4dabb42522b7 tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-dcb94ed9-61fd-43b3-adad-b87d5837bc1f-delete_volume" released by "delete_volume" :: held 3.810s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:09:57 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=114,cinder:UPDATE=134,cinder:INSERT=30,cinder:DELETE=10 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:09:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-18daf9a8-b181-42ad-afb8-37cad3ee4842 req-9a8c7738-409b-4b7b-b5ef-19c237d270fc tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:09:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-18daf9a8-b181-42ad-afb8-37cad3ee4842 req-9a8c7738-409b-4b7b-b5ef-19c237d270fc tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:09:57 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e8bc4f-6f6d-4741-9f69-e052ff920353]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:09:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-18daf9a8-b181-42ad-afb8-37cad3ee4842 req-9a8c7738-409b-4b7b-b5ef-19c237d270fc tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:09:57 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb Jul 09 05:09:57 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:09:58 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 09 05:09:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-18daf9a8-b181-42ad-afb8-37cad3ee4842 req-9a8c7738-409b-4b7b-b5ef-19c237d270fc tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb" returned: 0 in 1.008s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:09:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-18daf9a8-b181-42ad-afb8-37cad3ee4842 req-9a8c7738-409b-4b7b-b5ef-19c237d270fc tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.047s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:09:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-18daf9a8-b181-42ad-afb8-37cad3ee4842 req-9a8c7738-409b-4b7b-b5ef-19c237d270fc tempest-TestServerVolumeAttachmentScenario-1525917369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-9402b49b-8b78-41f6-ac1c-40f2408078fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c888a70-6917-4e5b-bdfe-d491d543bd05', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:09:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-18daf9a8-b181-42ad-afb8-37cad3ee4842 req-9a8c7738-409b-4b7b-b5ef-19c237d270fc tempest-TestServerVolumeAttachmentScenario-1525917369 None] attachment_update completed successfully. Jul 09 05:09:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-3e7609d7-8ad7-445d-896e-58b9aa1f72e7 req-7080ea04-d891-4573-93c3-7c97984e6fe1 tempest-TestInstancesWithCinderVolumes-961223282 None] Terminate volume connection completed successfully. Jul 09 05:09:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-3e7609d7-8ad7-445d-896e-58b9aa1f72e7 req-7080ea04-d891-4573-93c3-7c97984e6fe1 tempest-TestInstancesWithCinderVolumes-961223282 None] Deleting attachment a4931c85-bce7-4997-9a81-522a65b542cb. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:10:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "cinder-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "cinder-quobyte-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-quobyte-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:02 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa95770-3fd8-41e5-bb3d-762a143e051a]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:10:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:02 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 Jul 09 05:10:02 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:03 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" returned: 0 in 0.844s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:03 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 Jul 09 05:10:03 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:04 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" returned: 1 in 0.879s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:04 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1 Jul 09 05:10:04 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:04 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" returned: 0 in 0.694s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-quobyte-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1" released by "delete_volume" :: held 2.493s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:04 devstack cinder-volume[87161]: WARNING cinder.quota [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-617079011-1212717678 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-617079011-1212717678, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:10:04 devstack cinder-volume[87161]: WARNING cinder.quota [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-617079011-1212717678 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-617079011-1212717678, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Created reservations ['be65d11b-2c88-4454-85eb-22b22c791b35', 'b6294864-d505-4556-a104-69fefcfa7953', '878a1e48-1ee2-43e0-8a26-41bda1d5cde5', 'efb3f843-3d0e-4465-8a60-51ba95cd1451'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:05 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:10:05 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:05 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.845s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:05 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:10:05 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Deleted volume successfully. Jul 09 05:10:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7a201dbc-c76f-4e77-bbe8-fbda517c5b2e tempest-TestInstancesWithCinderVolumes-961223282 None] Lock "cinder-c2df04e0-cf1f-40c2-88ab-64203b7f2dd1-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-cf1dba31-60d4-4e47-b2d9-417df07b18e0 req-fd9a864e-21cd-4d67-8006-76c62996e7cb tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-cf1dba31-60d4-4e47-b2d9-417df07b18e0 req-fd9a864e-21cd-4d67-8006-76c62996e7cb tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:08 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d38a1-c53e-4bb7-9cf8-cf79536cadb9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:10:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-cf1dba31-60d4-4e47-b2d9-417df07b18e0 req-fd9a864e-21cd-4d67-8006-76c62996e7cb tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:08 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 Jul 09 05:10:08 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:09 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-cf1dba31-60d4-4e47-b2d9-417df07b18e0 req-fd9a864e-21cd-4d67-8006-76c62996e7cb tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31" returned: 0 in 0.901s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-cf1dba31-60d4-4e47-b2d9-417df07b18e0 req-fd9a864e-21cd-4d67-8006-76c62996e7cb tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.925s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-cf1dba31-60d4-4e47-b2d9-417df07b18e0 req-fd9a864e-21cd-4d67-8006-76c62996e7cb tempest-TestServerVolumeAttachmentScenario-1525917369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4721c24-a6dc-4554-a5da-a30ae5444c49', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:10:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-cf1dba31-60d4-4e47-b2d9-417df07b18e0 req-fd9a864e-21cd-4d67-8006-76c62996e7cb tempest-TestServerVolumeAttachmentScenario-1525917369 None] attachment_update completed successfully. Jul 09 05:10:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-4fb7761b-1fa0-462c-b12b-4c49f37be81e req-8a98de71-dbb7-4f82-9673-a9ba4e965be3 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Terminate volume connection completed successfully. Jul 09 05:10:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-4fb7761b-1fa0-462c-b12b-4c49f37be81e req-8a98de71-dbb7-4f82-9673-a9ba4e965be3 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Deleting attachment b4721c24-a6dc-4554-a5da-a30ae5444c49. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:10:19 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=17,cinder:UPDATE=12,cinder:INSERT=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:10:20 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-8ed82450-e8c8-40bd-a4af-0b6688625a7c req-f29e9423-f1d5-4a4a-9f32-afd2ab177002 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Terminate volume connection completed successfully. Jul 09 05:10:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-8ed82450-e8c8-40bd-a4af-0b6688625a7c req-f29e9423-f1d5-4a4a-9f32-afd2ab177002 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Deleting attachment 6c888a70-6917-4e5b-bdfe-d491d543bd05. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:10:30 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:10:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "cinder-311e2c44-0895-4e4f-8c1e-ee6a96658c31-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "cinder-311e2c44-0895-4e4f-8c1e-ee6a96658c31-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "cinder-quobyte-311e2c44-0895-4e4f-8c1e-ee6a96658c31" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "cinder-quobyte-311e2c44-0895-4e4f-8c1e-ee6a96658c31" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:31 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c95e7c4-5195-48f8-9804-bf6f602ec71e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:10:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:31 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 Jul 09 05:10:31 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:32 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31" returned: 0 in 0.868s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:32 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31 Jul 09 05:10:32 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:33 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-311e2c44-0895-4e4f-8c1e-ee6a96658c31" returned: 0 in 0.768s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "cinder-quobyte-311e2c44-0895-4e4f-8c1e-ee6a96658c31" released by "delete_volume" :: held 1.692s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Created reservations ['83c714aa-bfc9-49b3-8e58-e04d9f502cdd', 'dc01c3bd-41bf-4702-8a2e-230a015e6a31', '8d0623ff-d7cf-42f2-8722-1e5b7d78fbbe', '094d2475-f98e-451b-9b9c-e8c76532231c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:33 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:10:33 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "cinder-9402b49b-8b78-41f6-ac1c-40f2408078fb-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "cinder-9402b49b-8b78-41f6-ac1c-40f2408078fb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "cinder-quobyte-9402b49b-8b78-41f6-ac1c-40f2408078fb" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "cinder-quobyte-9402b49b-8b78-41f6-ac1c-40f2408078fb" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9973c3-7d8d-415e-a482-ca6f8086a4a0]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:10:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:34 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb Jul 09 05:10:34 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:34 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.870s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:34 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:10:34 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Deleted volume successfully. Jul 09 05:10:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d2e220b7-42e3-4436-8e84-d823e55e58cd tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "cinder-311e2c44-0895-4e4f-8c1e-ee6a96658c31-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:34 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb" returned: 0 in 0.948s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:34 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb Jul 09 05:10:34 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:35 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9402b49b-8b78-41f6-ac1c-40f2408078fb" returned: 0 in 0.733s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "cinder-quobyte-9402b49b-8b78-41f6-ac1c-40f2408078fb" released by "delete_volume" :: held 1.764s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:35 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Created reservations ['9fa2442b-d787-471d-b334-d72df46908a2', 'f959e976-d615-4aed-8ba9-47fe78679c75', '22ced1fb-4357-4890-9362-c0a85db128e4', '8fc6c42e-0ca8-4545-bed1-0d52b5aee681'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:10:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:35 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:10:35 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:36 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.676s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:36 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:10:36 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Deleted volume successfully. Jul 09 05:10:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e9b9113f-8201-4074-905c-70023a5c3130 tempest-TestServerVolumeAttachmentScenario-1525917369 None] Lock "cinder-9402b49b-8b78-41f6-ac1c-40f2408078fb-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:39 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:10:39 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:39 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.890s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:10:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:10:46 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Flow 'volume_create_manager' (4a557091-4a49-4f11-b926-c38cee61e2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7902f916-99f0-45e1-9707-d04ed5c73cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7902f916-99f0-45e1-9707-d04ed5c73cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-286137119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb953eab-3b90-49db-a00c-2906e3406711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87fd8a69c97245a2a597fb05a8661592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:47Z,use_quota=True,user_id='f77d0d1ca5dc454eb00693eb9febc985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e7b46b-1071-4405-bffb-77ab10253ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e7b46b-1071-4405-bffb-77ab10253ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6318b766-3f0b-433b-8e4f-ec6191192282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6318b766-3f0b-433b-8e4f-ec6191192282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb953eab-3b90-49db-a00c-2906e3406711', 'volume_name': 'volume-bb953eab-3b90-49db-a00c-2906e3406711', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ce7dde-f856-42c6-bbfc-3f43acea7800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ce7dde-f856-42c6-bbfc-3f43acea7800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d4ea34-3352-4a13-b6bf-f8f897a2fff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:47 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Volume bb953eab-3b90-49db-a00c-2906e3406711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb953eab-3b90-49db-a00c-2906e3406711', 'volume_size': 1} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-286137119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb953eab-3b90-49db-a00c-2906e3406711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87fd8a69c97245a2a597fb05a8661592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:47Z,use_quota=True,user_id='f77d0d1ca5dc454eb00693eb9febc985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Creating volume bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:10:47 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:47 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 1073741824 Jul 09 05:10:47 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (31d11a77-f503-4933-9c06-3b20aa3db831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d891add-b44b-459e-9d67-a2b23d0caeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d891add-b44b-459e-9d67-a2b23d0caeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002218620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1206b019-7ef9-455c-a654-e6e67b7a5f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:48Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60583e9-9418-4eb0-a4b9-97b00e78cf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60583e9-9418-4eb0-a4b9-97b00e78cf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac07f78-aef7-4aad-b180-efb398d5700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac07f78-aef7-4aad-b180-efb398d5700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1206b019-7ef9-455c-a654-e6e67b7a5f7e', 'volume_name': 'volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af205bfd-6e59-4db6-a6c7-493a60249f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af205bfd-6e59-4db6-a6c7-493a60249f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06928dec-f699-4ba0-8fa4-ae2cac699951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:48 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Volume 1206b019-7ef9-455c-a654-e6e67b7a5f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e', 'volume_size': 1} Jul 09 05:10:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:48 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 1073741824" returned: 0 in 1.315s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:49 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 Jul 09 05:10:49 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:49 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711" returned: 0 in 0.723s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.709s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002218620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1206b019-7ef9-455c-a654-e6e67b7a5f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:48Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Creating volume 1206b019-7ef9-455c-a654-e6e67b7a5f7e {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:10:49 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d4ea34-3352-4a13-b6bf-f8f897a2fff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb953eab-3b90-49db-a00c-2906e3406711', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:49 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e 1073741824 Jul 09 05:10:49 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3188fc20-dfc2-4eea-ac9a-748b106fcae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:49 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Volume volume-bb953eab-3b90-49db-a00c-2906e3406711 (bb953eab-3b90-49db-a00c-2906e3406711): created successfully Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3188fc20-dfc2-4eea-ac9a-748b106fcae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Flow 'volume_create_manager' (4a557091-4a49-4f11-b926-c38cee61e2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:49 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6cd5f978-3e34-4504-bb39-8ba2f6c05c82 tempest-TestStampPattern-894160609 None] Created volume successfully. Jul 09 05:10:50 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e 1073741824" returned: 0 in 1.120s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:50 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e Jul 09 05:10:50 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:51 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e" returned: 0 in 0.753s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:10:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06928dec-f699-4ba0-8fa4-ae2cac699951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032cb882-5bb1-4c3c-9ae8-cdff570a3376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:51 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Volume volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e (1206b019-7ef9-455c-a654-e6e67b7a5f7e): created successfully Jul 09 05:10:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032cb882-5bb1-4c3c-9ae8-cdff570a3376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (31d11a77-f503-4933-9c06-3b20aa3db831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b66bd950-8c37-491a-93a1-b84afe4dfb77 tempest-VolumesActionsTest-1291639670 None] Created volume successfully. Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13421f7a-5072-4dd1-8891-f89b27b1fa77 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e" by "attach_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13421f7a-5072-4dd1-8891-f89b27b1fa77 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e" acquired by "attach_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:52 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-13421f7a-5072-4dd1-8891-f89b27b1fa77 tempest-VolumesActionsTest-1291639670 None] Attaching volume 1206b019-7ef9-455c-a654-e6e67b7a5f7e to instance 1b018290-85c6-4b2a-ba61-bf376b47a352 at mountpoint /dev/vdb on host None. Jul 09 05:10:52 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-13421f7a-5072-4dd1-8891-f89b27b1fa77 tempest-VolumesActionsTest-1291639670 None] Attach volume completed successfully. Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13421f7a-5072-4dd1-8891-f89b27b1fa77 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e" released by "attach_volume" :: held 0.124s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Flow 'volume_create_manager' (59748a58-4017-47a5-81ae-863632415e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d975ae08-42fe-4877-b188-ecef8f191083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d975ae08-42fe-4877-b188-ecef8f191083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1911358511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c80be2-8d73-40d2-acb3-cf2939bea042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775bee7dbb42447fb44bc57c2dd2d8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:53Z,use_quota=True,user_id='2a23814496614b20bcc58ed4fbdb09d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb4ed21-99af-45cd-8111-17c2b1b37495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb4ed21-99af-45cd-8111-17c2b1b37495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf03e0fa-08bf-4d8f-9415-1987b2e61e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf03e0fa-08bf-4d8f-9415-1987b2e61e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c80be2-8d73-40d2-acb3-cf2939bea042', 'volume_name': 'volume-23c80be2-8d73-40d2-acb3-cf2939bea042', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34427b35-ecc4-4053-874d-cda3857b347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34427b35-ecc4-4053-874d-cda3857b347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d9b82d-5891-493c-a064-0b140e18e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:52 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Volume 23c80be2-8d73-40d2-acb3-cf2939bea042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c80be2-8d73-40d2-acb3-cf2939bea042', 'volume_size': 1} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1911358511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c80be2-8d73-40d2-acb3-cf2939bea042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775bee7dbb42447fb44bc57c2dd2d8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:53Z,use_quota=True,user_id='2a23814496614b20bcc58ed4fbdb09d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Creating volume 23c80be2-8d73-40d2-acb3-cf2939bea042 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:10:52 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:10:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:53 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042 1073741824 Jul 09 05:10:53 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:53 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1f074ca0-2f6d-455b-9d7f-afba8c2af222 tempest-VolumesActionsTest-668727396 None] Terminate volume connection completed successfully. Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Flow 'volume_create_manager' (da9feb41-e5b1-4937-89a4-cac259b53eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ecaca5-cdb1-4456-83e6-eee5cc4be8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ecaca5-cdb1-4456-83e6-eee5cc4be8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-243034146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e981d5a9-e326-47e6-926c-7682d37e7caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775bee7dbb42447fb44bc57c2dd2d8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:53Z,use_quota=True,user_id='2a23814496614b20bcc58ed4fbdb09d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a65311f-1e49-47d1-b888-240cb0337624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a65311f-1e49-47d1-b888-240cb0337624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937ce25c-1a9d-4185-abdf-c1e0ea80345d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937ce25c-1a9d-4185-abdf-c1e0ea80345d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e981d5a9-e326-47e6-926c-7682d37e7caa', 'volume_name': 'volume-e981d5a9-e326-47e6-926c-7682d37e7caa', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5112ae0-9580-4f0e-ab4e-caa47f522261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5112ae0-9580-4f0e-ab4e-caa47f522261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9099e3-1cba-4355-8d12-c3bac4828fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:53 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Volume e981d5a9-e326-47e6-926c-7682d37e7caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e981d5a9-e326-47e6-926c-7682d37e7caa', 'volume_size': 1} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1f074ca0-2f6d-455b-9d7f-afba8c2af222 tempest-VolumesActionsTest-668727396 None] Acquiring lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e-detach_volume" by "detach_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1f074ca0-2f6d-455b-9d7f-afba8c2af222 tempest-VolumesActionsTest-668727396 None] Lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1f074ca0-2f6d-455b-9d7f-afba8c2af222 tempest-VolumesActionsTest-668727396 None] Detaching volume 1206b019-7ef9-455c-a654-e6e67b7a5f7e from instance 1b018290-85c6-4b2a-ba61-bf376b47a352. Jul 09 05:10:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1f074ca0-2f6d-455b-9d7f-afba8c2af222 tempest-VolumesActionsTest-668727396 None] Detach volume completed successfully. Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1f074ca0-2f6d-455b-9d7f-afba8c2af222 tempest-VolumesActionsTest-668727396 None] Lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e-detach_volume" released by "detach_volume" :: held 0.274s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:10:54 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Flow 'volume_create_manager' (185203f0-b1bb-47d8-bad9-6ba1aabc2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd34de8-8d4e-4c8b-b108-52c8748b4de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042 1073741824" returned: 0 in 1.425s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd34de8-8d4e-4c8b-b108-52c8748b4de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-389550089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed20fce4-6277-429a-9d86-c38061c3c905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775bee7dbb42447fb44bc57c2dd2d8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:54Z,use_quota=True,user_id='2a23814496614b20bcc58ed4fbdb09d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419d385a-85fd-4e83-abd7-5d06102c87bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419d385a-85fd-4e83-abd7-5d06102c87bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511b9da0-33e1-480a-b336-3d2670eb401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511b9da0-33e1-480a-b336-3d2670eb401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed20fce4-6277-429a-9d86-c38061c3c905', 'volume_name': 'volume-ed20fce4-6277-429a-9d86-c38061c3c905', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0849fe2a-61b1-43fa-8b07-4684bad109f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0849fe2a-61b1-43fa-8b07-4684bad109f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db43fa2-33e1-4183-bc29-a4e667230091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:54 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Volume ed20fce4-6277-429a-9d86-c38061c3c905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed20fce4-6277-429a-9d86-c38061c3c905', 'volume_size': 1} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:54 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042 Jul 09 05:10:54 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-05e8bbc8-e2de-49e1-90f3-74286c394ff1 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e-detach_volume" by "detach_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-05e8bbc8-e2de-49e1-90f3-74286c394ff1 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-05e8bbc8-e2de-49e1-90f3-74286c394ff1 tempest-VolumesActionsTest-1291639670 None] Volume detach called, but volume not attached. Jul 09 05:10:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-05e8bbc8-e2de-49e1-90f3-74286c394ff1 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Flow 'volume_create_manager' (c1777022-6e2e-492f-8fc2-09fc8d02ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee00145-e41d-412a-903b-0da640831211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee00145-e41d-412a-903b-0da640831211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018627049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081b08c7-1518-47fd-86cf-fd49fc967b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775bee7dbb42447fb44bc57c2dd2d8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:55Z,use_quota=True,user_id='2a23814496614b20bcc58ed4fbdb09d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21919591-e25b-42f4-bd23-8d9ad48875c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21919591-e25b-42f4-bd23-8d9ad48875c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd6bf7d-a738-43e1-a9cd-c8d199436950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd6bf7d-a738-43e1-a9cd-c8d199436950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081b08c7-1518-47fd-86cf-fd49fc967b23', 'volume_name': 'volume-081b08c7-1518-47fd-86cf-fd49fc967b23', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68543be-98d3-4680-93e8-e056fb359383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68543be-98d3-4680-93e8-e056fb359383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87119f43-3828-42af-aec8-50e04c3122f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:55 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Volume 081b08c7-1518-47fd-86cf-fd49fc967b23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081b08c7-1518-47fd-86cf-fd49fc967b23', 'volume_size': 1} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:55 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042" returned: 0 in 1.260s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] <== create_volume: return (2850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.852s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.951s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-243034146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e981d5a9-e326-47e6-926c-7682d37e7caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775bee7dbb42447fb44bc57c2dd2d8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:53Z,use_quota=True,user_id='2a23814496614b20bcc58ed4fbdb09d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Creating volume e981d5a9-e326-47e6-926c-7682d37e7caa {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:10:55 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d9b82d-5891-493c-a064-0b140e18e842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c80be2-8d73-40d2-acb3-cf2939bea042', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:55 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa 1073741824 Jul 09 05:10:55 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d6b114-1394-480e-85e6-9c3f83452245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Volume volume-23c80be2-8d73-40d2-acb3-cf2939bea042 (23c80be2-8d73-40d2-acb3-cf2939bea042): created successfully Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d6b114-1394-480e-85e6-9c3f83452245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Flow 'volume_create_manager' (59748a58-4017-47a5-81ae-863632415e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-df35a191-860e-4a27-b352-d45d24c071cf tempest-CreateVolumesFromImageTest-424646453 None] Created volume successfully. Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "cinder-quobyte-1206b019-7ef9-455c-a654-e6e67b7a5f7e" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-quobyte-1206b019-7ef9-455c-a654-e6e67b7a5f7e" acquired by "delete_volume" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1365c77f-967b-4021-a79c-35ef20a6dc63]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Flow 'volume_create_manager' (4671a8a9-072a-4de0-83a7-f97731edb865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:56 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e Jul 09 05:10:56 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b7f8ed-ee05-45ca-9522-365238352a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b7f8ed-ee05-45ca-9522-365238352a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092838999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b007f6e-6a05-4a46-bce1-afc2df9c5be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775bee7dbb42447fb44bc57c2dd2d8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:56Z,use_quota=True,user_id='2a23814496614b20bcc58ed4fbdb09d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f628268a-ca2a-46d6-ad45-a7f46587c952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f628268a-ca2a-46d6-ad45-a7f46587c952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ac5ee8-3341-4023-b13d-27367f528bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ac5ee8-3341-4023-b13d-27367f528bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b007f6e-6a05-4a46-bce1-afc2df9c5be1', 'volume_name': 'volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec638a2-99f4-4793-8793-a96f466db626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec638a2-99f4-4793-8793-a96f466db626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004ee2f3-b4c0-46a2-9619-fab5d52aaa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Volume 7b007f6e-6a05-4a46-bce1-afc2df9c5be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1', 'volume_size': 1} Jul 09 05:10:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:57 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa 1073741824" returned: 0 in 1.370s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:57 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa Jul 09 05:10:57 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:57 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e" returned: 0 in 1.213s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:57 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e Jul 09 05:10:57 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:58 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa" returned: 0 in 0.813s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.609s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-389550089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed20fce4-6277-429a-9d86-c38061c3c905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775bee7dbb42447fb44bc57c2dd2d8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:54Z,use_quota=True,user_id='2a23814496614b20bcc58ed4fbdb09d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Creating volume ed20fce4-6277-429a-9d86-c38061c3c905 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:10:58 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9099e3-1cba-4355-8d12-c3bac4828fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e981d5a9-e326-47e6-926c-7682d37e7caa', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c587a5f-b684-4602-b0e2-ea8a14cf162a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:58 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905 1073741824 Jul 09 05:10:58 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:58 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Volume volume-e981d5a9-e326-47e6-926c-7682d37e7caa (e981d5a9-e326-47e6-926c-7682d37e7caa): created successfully Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c587a5f-b684-4602-b0e2-ea8a14cf162a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Flow 'volume_create_manager' (da9feb41-e5b1-4937-89a4-cac259b53eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-80cc0d80-4112-4293-9a40-7f65ae9e8b69 tempest-CreateVolumesFromImageTest-424646453 None] Created volume successfully. Jul 09 05:10:58 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1206b019-7ef9-455c-a654-e6e67b7a5f7e" returned: 0 in 0.741s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-quobyte-1206b019-7ef9-455c-a654-e6e67b7a5f7e" released by "delete_volume" :: held 2.030s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Created reservations ['b97db4cc-df56-4959-8d83-ac288190b9d3', '87e47f57-e5d3-41aa-9625-e0cd57225cf6', 'a40d9c3d-c562-4db7-8c69-3dbd1b33c48c', 'eb90989b-3878-491f-b979-e7be82952d3c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:58 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:10:58 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:59 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905 1073741824" returned: 0 in 0.920s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:59 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.671s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:10:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Deleted volume successfully. Jul 09 05:10:59 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905 Jul 09 05:10:59 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-be88f5fb-7c59-49f5-aaf2-63169007a8a7 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-1206b019-7ef9-455c-a654-e6e67b7a5f7e-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:10:59 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905" returned: 0 in 0.706s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.152s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018627049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081b08c7-1518-47fd-86cf-fd49fc967b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775bee7dbb42447fb44bc57c2dd2d8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:55Z,use_quota=True,user_id='2a23814496614b20bcc58ed4fbdb09d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Creating volume 081b08c7-1518-47fd-86cf-fd49fc967b23 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:10:59 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db43fa2-33e1-4183-bc29-a4e667230091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed20fce4-6277-429a-9d86-c38061c3c905', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:59 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23 1073741824 Jul 09 05:10:59 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4449dc-36a9-4b0a-a442-73611ff9fe08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:10:59 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Volume volume-ed20fce4-6277-429a-9d86-c38061c3c905 (ed20fce4-6277-429a-9d86-c38061c3c905): created successfully Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4449dc-36a9-4b0a-a442-73611ff9fe08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:10:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Flow 'volume_create_manager' (185203f0-b1bb-47d8-bad9-6ba1aabc2a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:10:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-600141bb-d006-42f7-932f-02f73d03ae32 tempest-CreateVolumesFromImageTest-424646453 None] Created volume successfully. Jul 09 05:11:00 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23 1073741824" returned: 0 in 0.818s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:00 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23 Jul 09 05:11:00 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:01 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23" returned: 0 in 0.833s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.813s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092838999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b007f6e-6a05-4a46-bce1-afc2df9c5be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775bee7dbb42447fb44bc57c2dd2d8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:10:56Z,use_quota=True,user_id='2a23814496614b20bcc58ed4fbdb09d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Creating volume 7b007f6e-6a05-4a46-bce1-afc2df9c5be1 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:01 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:01 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1 1073741824 Jul 09 05:11:01 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87119f43-3828-42af-aec8-50e04c3122f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081b08c7-1518-47fd-86cf-fd49fc967b23', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b03eb6f-61ca-4814-9e66-b38792c5a2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:01 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Volume volume-081b08c7-1518-47fd-86cf-fd49fc967b23 (081b08c7-1518-47fd-86cf-fd49fc967b23): created successfully Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b03eb6f-61ca-4814-9e66-b38792c5a2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Flow 'volume_create_manager' (c1777022-6e2e-492f-8fc2-09fc8d02ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:01 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6a9d7b5f-4f8a-4686-adf2-bf9fc553272d tempest-CreateVolumesFromImageTest-424646453 None] Created volume successfully. Jul 09 05:11:02 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1 1073741824" returned: 0 in 1.263s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:02 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1 Jul 09 05:11:02 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:03 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1" returned: 0 in 0.690s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004ee2f3-b4c0-46a2-9619-fab5d52aaa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f71da7-72e6-458f-aedb-63ea213aad23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:03 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Volume volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1 (7b007f6e-6a05-4a46-bce1-afc2df9c5be1): created successfully Jul 09 05:11:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f71da7-72e6-458f-aedb-63ea213aad23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Flow 'volume_create_manager' (4671a8a9-072a-4de0-83a7-f97731edb865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-166742bf-d90d-41d5-a4ea-aba27d05c2ad tempest-CreateVolumesFromImageTest-424646453 None] Created volume successfully. Jul 09 05:11:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "cinder-7b007f6e-6a05-4a46-bce1-afc2df9c5be1-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-7b007f6e-6a05-4a46-bce1-afc2df9c5be1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "cinder-quobyte-7b007f6e-6a05-4a46-bce1-afc2df9c5be1" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-quobyte-7b007f6e-6a05-4a46-bce1-afc2df9c5be1" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:04 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3bc817-35eb-43bf-a513-9c5e7da8bed4]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:04 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1 Jul 09 05:11:04 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:05 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1" returned: 0 in 0.853s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:05 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1 Jul 09 05:11:05 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:05 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7b007f6e-6a05-4a46-bce1-afc2df9c5be1" returned: 0 in 0.677s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-quobyte-7b007f6e-6a05-4a46-bce1-afc2df9c5be1" released by "delete_volume" :: held 1.575s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Created reservations ['cfd4cefb-9b22-4856-aa3e-bc9a7c297d8a', '5e666701-83f9-4048-bef8-eee70800139a', '3ed680a9-fdde-443f-95fb-d90c3c1e5c5c', '7b7eeb61-63c8-44ed-85e7-85a0dea81cbf'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:05 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:05 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "cinder-081b08c7-1518-47fd-86cf-fd49fc967b23-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-081b08c7-1518-47fd-86cf-fd49fc967b23-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "cinder-quobyte-081b08c7-1518-47fd-86cf-fd49fc967b23" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-quobyte-081b08c7-1518-47fd-86cf-fd49fc967b23" acquired by "delete_volume" :: waited 0.035s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:06 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58c5bed-17e3-49e8-8bd2-917db4ecb9a3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:06 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:06 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:06 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Deleted volume successfully. Jul 09 05:11:06 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23 Jul 09 05:11:06 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7b470296-d73b-4cb1-a6d5-da5c082a837a tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-7b007f6e-6a05-4a46-bce1-afc2df9c5be1-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:07 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23" returned: 0 in 0.883s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:07 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23 Jul 09 05:11:07 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (b2ffc5a2-4933-460a-a534-14cf714e7555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f974c1b0-80f0-464b-8fbd-bba1f0c1fcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f974c1b0-80f0-464b-8fbd-bba1f0c1fcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-789575560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:08Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa3b138-c84c-4a19-aae8-0c5b2db24a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa3b138-c84c-4a19-aae8-0c5b2db24a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0746f60a-065f-4353-ac2c-160ff5379bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0746f60a-065f-4353-ac2c-160ff5379bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624', 'volume_name': 'volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609ad4b0-6df2-4a39-ac0a-8eaea6d3f32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609ad4b0-6df2-4a39-ac0a-8eaea6d3f32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162b0809-9055-4449-bfa5-cc0e38cd960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:07 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Volume f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624', 'volume_size': 1} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-789575560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:08Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Creating volume f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:07 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:07 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 1073741824 Jul 09 05:11:07 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:08 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-081b08c7-1518-47fd-86cf-fd49fc967b23" returned: 0 in 0.855s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-quobyte-081b08c7-1518-47fd-86cf-fd49fc967b23" released by "delete_volume" :: held 1.810s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Created reservations ['fae5e9bb-c11a-4bd3-b792-5c620b8c87fa', '71afa58f-1ccb-46b1-84f0-6790c5fd0c91', '229b446a-ec8f-4f55-89bd-75c0edb947d9', 'fd9f0a5b-b255-49e5-8069-250f7cd24f42'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:08 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:08 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "cinder-ed20fce4-6277-429a-9d86-c38061c3c905-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-ed20fce4-6277-429a-9d86-c38061c3c905-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "cinder-quobyte-ed20fce4-6277-429a-9d86-c38061c3c905" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-quobyte-ed20fce4-6277-429a-9d86-c38061c3c905" acquired by "delete_volume" :: waited 0.048s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:09 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 1073741824" returned: 0 in 1.136s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:09 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[093cb711-bcac-4f7a-ab20-19a65d93b0df]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:09 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 Jul 09 05:11:09 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:09 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905 Jul 09 05:11:09 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:09 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.243s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:09 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Deleted volume successfully. Jul 09 05:11:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4206a02a-bd07-4fe6-9a08-b63daf84bf36 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-081b08c7-1518-47fd-86cf-fd49fc967b23-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:10 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905" returned: 0 in 1.193s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:10 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624" returned: 0 in 1.149s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:10 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905 Jul 09 05:11:10 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162b0809-9055-4449-bfa5-cc0e38cd960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89537ae8-cc66-484f-989e-6b546fea1256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:10 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Volume volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 (f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624): created successfully Jul 09 05:11:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89537ae8-cc66-484f-989e-6b546fea1256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (b2ffc5a2-4933-460a-a534-14cf714e7555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:10 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ac5dd609-9477-4e8b-9643-02aa68866803 tempest-VolumesActionsTest-1291639670 None] Created volume successfully. Jul 09 05:11:11 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ed20fce4-6277-429a-9d86-c38061c3c905" returned: 0 in 0.728s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-quobyte-ed20fce4-6277-429a-9d86-c38061c3c905" released by "delete_volume" :: held 1.988s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Created reservations ['e86a12a9-9bb2-4a2e-9147-6f30c945608b', 'b7dcc0da-a800-4c22-9a6f-784af88e6091', '34a5d059-171e-4b22-aaba-29100c56a06c', '011e3700-9e57-47d4-9790-1978305a75d5'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:11 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:11 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "cinder-e981d5a9-e326-47e6-926c-7682d37e7caa-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Acquiring lock "cinder-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-e981d5a9-e326-47e6-926c-7682d37e7caa-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Lock "cinder-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "cinder-quobyte-e981d5a9-e326-47e6-926c-7682d37e7caa" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Acquiring lock "cinder-quobyte-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-quobyte-e981d5a9-e326-47e6-926c-7682d37e7caa" acquired by "delete_volume" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Lock "cinder-quobyte-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624" acquired by "delete_volume" :: waited 0.035s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b84f834-e84b-4918-97fe-a768190892bd]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d99a674-81e0-4563-8382-f99c555b4d87]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:11 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 Jul 09 05:11:11 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:11 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa Jul 09 05:11:11 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:12 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.867s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:12 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:12 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Deleted volume successfully. Jul 09 05:11:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-36dcdb6b-19a0-4f44-8506-eb33ccd94ca4 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-ed20fce4-6277-429a-9d86-c38061c3c905-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:12 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624" returned: 0 in 0.816s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:12 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624 Jul 09 05:11:12 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:12 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa" returned: 0 in 0.976s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:12 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa Jul 09 05:11:12 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:13 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624" returned: 0 in 0.689s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Lock "cinder-quobyte-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624" released by "delete_volume" :: held 1.567s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Created reservations ['6bb8c22f-01e5-4b72-8e68-5117a01db682', '52ed0e57-cdee-497d-bff4-72910fcd5396', '81fa5510-ec9b-4e37-ac1e-55f5462bee5b', '4825a540-650b-472e-9d76-39eef1dd5c4f'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:13 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e981d5a9-e326-47e6-926c-7682d37e7caa" returned: 0 in 0.685s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-quobyte-e981d5a9-e326-47e6-926c-7682d37e7caa" released by "delete_volume" :: held 1.710s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:13 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:13 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Created reservations ['35d61866-4814-49e9-ba0b-b24b94b0c80b', '1fc7f39f-b501-4ae6-b9ad-7774d9cae42b', 'b6f8f5c0-144a-4ba2-81b6-dfb7020e9d5f', 'de253c7a-6c63-4aad-b8c7-ca5e7c314373'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:13 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:13 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "cinder-23c80be2-8d73-40d2-acb3-cf2939bea042-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-23c80be2-8d73-40d2-acb3-cf2939bea042-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "cinder-quobyte-23c80be2-8d73-40d2-acb3-cf2939bea042" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-quobyte-23c80be2-8d73-40d2-acb3-cf2939bea042" acquired by "delete_volume" :: waited 0.039s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba7f016-0c37-456e-8e95-9549d1ffc92c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:14 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.878s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:14 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042 Jul 09 05:11:14 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:14 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Deleted volume successfully. Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e496c7ca-ffa9-4d11-b330-9e176deca3ce tempest-VolumesActionsTest-668727396 None] Lock "cinder-f9eb399b-7afc-4cfe-a3d8-e1dfa4f98624-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:14 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.900s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:14 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Deleted volume successfully. Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a8e87035-5f7c-4887-a739-30c2af6c5bcb tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-e981d5a9-e326-47e6-926c-7682d37e7caa-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (1ee6d525-86cf-48f1-9513-2ce1be3d9c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61785e2-7eee-4ea0-b1f9-ad231395cc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61785e2-7eee-4ea0-b1f9-ad231395cc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-935968824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6846767-359d-4b08-9fec-81fffe8728d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:14Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7476094-183e-4c25-baea-afa910a96896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7476094-183e-4c25-baea-afa910a96896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567078f6-6919-499a-a52b-3db0471090b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567078f6-6919-499a-a52b-3db0471090b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6846767-359d-4b08-9fec-81fffe8728d1', 'volume_name': 'volume-f6846767-359d-4b08-9fec-81fffe8728d1', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894e8393-f815-4a16-b573-38d47869caca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894e8393-f815-4a16-b573-38d47869caca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc35b35-38c9-4c6b-b3ca-10a470ebddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:14 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Volume f6846767-359d-4b08-9fec-81fffe8728d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6846767-359d-4b08-9fec-81fffe8728d1', 'volume_size': 1} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-935968824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6846767-359d-4b08-9fec-81fffe8728d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:14Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Creating volume f6846767-359d-4b08-9fec-81fffe8728d1 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:14 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:14 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1 1073741824 Jul 09 05:11:14 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:14 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042" returned: 0 in 0.960s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:14 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042 Jul 09 05:11:14 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:15 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1 1073741824" returned: 0 in 0.860s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:15 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1 Jul 09 05:11:15 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:15 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-23c80be2-8d73-40d2-acb3-cf2939bea042" returned: 0 in 0.729s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-quobyte-23c80be2-8d73-40d2-acb3-cf2939bea042" released by "delete_volume" :: held 1.753s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Created reservations ['329b291f-484b-44b8-a849-aac79c5186fd', '1db93dd7-b3ea-4f1b-aa57-88880fe4006d', 'e1155390-ff32-4041-9261-9a913762f7a4', 'c808182c-465b-4465-8988-deb24c15363c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:15 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:15 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:16 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1" returned: 0 in 0.753s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc35b35-38c9-4c6b-b3ca-10a470ebddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6846767-359d-4b08-9fec-81fffe8728d1', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f280e9b6-846a-4833-91df-d29e0de76ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:16 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Volume volume-f6846767-359d-4b08-9fec-81fffe8728d1 (f6846767-359d-4b08-9fec-81fffe8728d1): created successfully Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f280e9b6-846a-4833-91df-d29e0de76ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (1ee6d525-86cf-48f1-9513-2ce1be3d9c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8698c8a9-7c5e-498c-b78f-43b2de62163e tempest-VolumesActionsTest-1291639670 None] Created volume successfully. Jul 09 05:11:16 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.824s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Deleted volume successfully. Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4a86093f-710b-4aad-ac7c-073049d639f2 tempest-CreateVolumesFromImageTest-424646453 None] Lock "cinder-23c80be2-8d73-40d2-acb3-cf2939bea042-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Acquiring lock "cinder-f6846767-359d-4b08-9fec-81fffe8728d1-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Lock "cinder-f6846767-359d-4b08-9fec-81fffe8728d1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Acquiring lock "cinder-quobyte-f6846767-359d-4b08-9fec-81fffe8728d1" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Lock "cinder-quobyte-f6846767-359d-4b08-9fec-81fffe8728d1" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3388b3-687a-4b54-8f09-76b63249f8f0]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:17 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1 Jul 09 05:11:17 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:17 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1" returned: 0 in 0.796s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:17 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1 Jul 09 05:11:17 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:18 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f6846767-359d-4b08-9fec-81fffe8728d1" returned: 0 in 0.655s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Lock "cinder-quobyte-f6846767-359d-4b08-9fec-81fffe8728d1" released by "delete_volume" :: held 1.496s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:18 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Created reservations ['8a50372d-f16c-42ea-8922-48bca1985ea5', 'a60e0d70-7e23-43d8-8b9d-120ab76869e7', 'c9a11605-c663-4c68-8762-debb65c6911d', 'ca280258-52a7-4fd7-abf8-21aeb6ef5a95'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:18 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:18 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:19 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.655s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Deleted volume successfully. Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f5a13fe5-b1a4-4e10-8bd5-1e80e899d293 tempest-VolumesActionsTest-668727396 None] Lock "cinder-f6846767-359d-4b08-9fec-81fffe8728d1-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (5b17cc09-cdcc-42a3-8e88-753cd5c387b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b615b9b4-61ed-471e-b94f-b590e3c87f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b615b9b4-61ed-471e-b94f-b590e3c87f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1572246323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb27b59-6671-4dfb-8be0-4a077fc42a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:20Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a13a512-0272-49d9-91d2-5f62f4df2ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a13a512-0272-49d9-91d2-5f62f4df2ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a5eb62-a74e-442e-90a9-e1a5ce592ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a5eb62-a74e-442e-90a9-e1a5ce592ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb27b59-6671-4dfb-8be0-4a077fc42a75', 'volume_name': 'volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9b9087-fa7a-4d92-a470-7e28b587fc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9b9087-fa7a-4d92-a470-7e28b587fc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba7e60e-c106-4bfd-b197-08efec0674c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:19 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Volume aeb27b59-6671-4dfb-8be0-4a077fc42a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75', 'volume_size': 1} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1572246323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb27b59-6671-4dfb-8be0-4a077fc42a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:20Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Creating volume aeb27b59-6671-4dfb-8be0-4a077fc42a75 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:19 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:19 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75 1073741824 Jul 09 05:11:19 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Flow 'volume_create_manager' (6136cd4a-7541-4081-b221-2e6a51418886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81aa310f-70d9-416b-8695-f1775e04ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81aa310f-70d9-416b-8695-f1775e04ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1004568601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a574a8-d583-4838-be85-b7fb1901ec79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13eb9b52bcd54be2abad45c568e52c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:20Z,use_quota=True,user_id='79377fae82b54cf89f91450409eb1fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf46916-f228-4d8a-a46f-653c34f77589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf46916-f228-4d8a-a46f-653c34f77589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a570c4-28db-410e-8f59-8bf411fca029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a570c4-28db-410e-8f59-8bf411fca029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a574a8-d583-4838-be85-b7fb1901ec79', 'volume_name': 'volume-e8a574a8-d583-4838-be85-b7fb1901ec79', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cddeeb7a-7c8b-42bc-a6e5-073e504acc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cddeeb7a-7c8b-42bc-a6e5-073e504acc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0394b36a-953e-4960-a820-2aa7cc5efbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:19 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Volume e8a574a8-d583-4838-be85-b7fb1901ec79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a574a8-d583-4838-be85-b7fb1901ec79', 'volume_size': 1} Jul 09 05:11:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:20 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75 1073741824" returned: 0 in 0.853s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:20 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75 Jul 09 05:11:20 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:21 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75" returned: 0 in 0.613s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.354s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1004568601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a574a8-d583-4838-be85-b7fb1901ec79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13eb9b52bcd54be2abad45c568e52c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:20Z,use_quota=True,user_id='79377fae82b54cf89f91450409eb1fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Creating volume e8a574a8-d583-4838-be85-b7fb1901ec79 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:21 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba7e60e-c106-4bfd-b197-08efec0674c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:21 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79 1073741824 Jul 09 05:11:21 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d39b21-f528-4ba6-afa5-f914756e6282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:21 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Volume volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75 (aeb27b59-6671-4dfb-8be0-4a077fc42a75): created successfully Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d39b21-f528-4ba6-afa5-f914756e6282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (5b17cc09-cdcc-42a3-8e88-753cd5c387b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b1aad327-0671-4c5e-b238-8b3f7cb5c97d tempest-VolumesActionsTest-1291639670 None] Created volume successfully. Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Acquiring lock "cinder-aeb27b59-6671-4dfb-8be0-4a077fc42a75-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Lock "cinder-aeb27b59-6671-4dfb-8be0-4a077fc42a75-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Acquiring lock "cinder-quobyte-aeb27b59-6671-4dfb-8be0-4a077fc42a75" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Lock "cinder-quobyte-aeb27b59-6671-4dfb-8be0-4a077fc42a75" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac98a6-b50b-436e-8c9f-ff37993abb3e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:22 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75 Jul 09 05:11:22 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:22 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79 1073741824" returned: 0 in 0.856s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:22 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79 Jul 09 05:11:22 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:22 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75" returned: 0 in 0.797s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:22 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75 Jul 09 05:11:22 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:22 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79" returned: 0 in 0.693s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0394b36a-953e-4960-a820-2aa7cc5efbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a574a8-d583-4838-be85-b7fb1901ec79', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b876921-49e3-455e-8f89-6b09d96039f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:22 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Volume volume-e8a574a8-d583-4838-be85-b7fb1901ec79 (e8a574a8-d583-4838-be85-b7fb1901ec79): created successfully Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b876921-49e3-455e-8f89-6b09d96039f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Flow 'volume_create_manager' (6136cd4a-7541-4081-b221-2e6a51418886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:22 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f34d0ed3-15ad-4d4e-a5b4-40d4981e07cf tempest-ProjectReaderTests-1281412264 None] Created volume successfully. Jul 09 05:11:23 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-aeb27b59-6671-4dfb-8be0-4a077fc42a75" returned: 0 in 0.709s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Lock "cinder-quobyte-aeb27b59-6671-4dfb-8be0-4a077fc42a75" released by "delete_volume" :: held 1.547s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:23 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Created reservations ['51e7c7db-2fe2-4ba3-bef3-4d951d8e375b', 'b8004c22-d3c3-4202-ac12-8b4c69a257f3', 'b0fb5203-35aa-4e42-aa1a-47e2b42b2755', 'a88cd2bc-a9a5-4dc3-9c1c-956d45c99ce3'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:23 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:23 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Acquiring lock "cinder-e8a574a8-d583-4838-be85-b7fb1901ec79-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Lock "cinder-e8a574a8-d583-4838-be85-b7fb1901ec79-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:24 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.724s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:24 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Deleted volume successfully. Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Acquiring lock "cinder-quobyte-e8a574a8-d583-4838-be85-b7fb1901ec79" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d521a63-d832-435f-8c55-71614e2ba82e tempest-VolumesActionsTest-668727396 None] Lock "cinder-aeb27b59-6671-4dfb-8be0-4a077fc42a75-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Lock "cinder-quobyte-e8a574a8-d583-4838-be85-b7fb1901ec79" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd72a6d4-6036-4d16-aad8-3e75a12d6f85]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:24 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79 Jul 09 05:11:24 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (fa77c1f2-9f13-4d25-9cbc-c1c616890dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0381da71-4778-4f39-b6fa-89c734cbf824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0381da71-4778-4f39-b6fa-89c734cbf824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1901098459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:25Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe95a98-7115-4827-8369-a37eea40aded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe95a98-7115-4827-8369-a37eea40aded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f97a21-6cdd-4109-99b6-319c34361f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f97a21-6cdd-4109-99b6-319c34361f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7', 'volume_name': 'volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947a90ea-77c5-456d-a75b-2b3d0a081b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947a90ea-77c5-456d-a75b-2b3d0a081b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357d9e2d-b624-46ee-a91a-413a22c24ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:24 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Volume bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7', 'volume_size': 1} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1901098459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:25Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Creating volume bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:24 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:24 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 1073741824 Jul 09 05:11:24 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:25 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79" returned: 0 in 0.798s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:25 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79 Jul 09 05:11:25 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:25 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 1073741824" returned: 0 in 0.821s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:25 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 Jul 09 05:11:25 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:25 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8a574a8-d583-4838-be85-b7fb1901ec79" returned: 0 in 0.686s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Lock "cinder-quobyte-e8a574a8-d583-4838-be85-b7fb1901ec79" released by "delete_volume" :: held 1.546s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Created reservations ['a6f94727-7533-4c58-8937-8db91a893737', '774cf48a-f262-41d8-8719-8871e06577f9', 'c9cbe6e3-72e8-4545-8307-b0019342bf1b', '0bc12905-bf56-4535-b573-ec2c1a12da21'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:25 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:25 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:26 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7" returned: 0 in 0.646s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357d9e2d-b624-46ee-a91a-413a22c24ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2886043a-b95d-440c-99f7-873f62cfdbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:26 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Volume volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 (bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7): created successfully Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2886043a-b95d-440c-99f7-873f62cfdbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (fa77c1f2-9f13-4d25-9cbc-c1c616890dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:26 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-2ff72336-bd75-4460-99c4-c9ef48342c09 tempest-VolumesActionsTest-1291639670 None] Created volume successfully. Jul 09 05:11:26 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.648s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:26 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Deleted volume successfully. Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-09def3e8-6b0b-4a3b-a321-25a0bd68866f tempest-ProjectReaderTests-1281412264 None] Lock "cinder-e8a574a8-d583-4838-be85-b7fb1901ec79-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Flow 'volume_create_manager' (089be8dc-eb5a-45c3-96d2-b70f9054fe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec57573b-bbeb-412f-87b9-ebc82aed18ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec57573b-bbeb-412f-87b9-ebc82aed18ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1624258415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde7c377-f2de-493d-914a-3b9a0b5891a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13eb9b52bcd54be2abad45c568e52c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:27Z,use_quota=True,user_id='79377fae82b54cf89f91450409eb1fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3738381-0341-4772-a826-8134c9def01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3738381-0341-4772-a826-8134c9def01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8626a4-5669-4aa5-aff1-8f6e5d70cf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8626a4-5669-4aa5-aff1-8f6e5d70cf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde7c377-f2de-493d-914a-3b9a0b5891a6', 'volume_name': 'volume-cde7c377-f2de-493d-914a-3b9a0b5891a6', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969b517d-8db7-4125-a33b-28f1790928d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969b517d-8db7-4125-a33b-28f1790928d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b520b863-a658-4c7f-9b0a-30b7ea0ffc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:26 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Volume cde7c377-f2de-493d-914a-3b9a0b5891a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde7c377-f2de-493d-914a-3b9a0b5891a6', 'volume_size': 1} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1624258415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde7c377-f2de-493d-914a-3b9a0b5891a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13eb9b52bcd54be2abad45c568e52c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:27Z,use_quota=True,user_id='79377fae82b54cf89f91450409eb1fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Creating volume cde7c377-f2de-493d-914a-3b9a0b5891a6 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:26 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Acquiring lock "cinder-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:27 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6 1073741824 Jul 09 05:11:27 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Lock "cinder-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Acquiring lock "cinder-quobyte-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Lock "cinder-quobyte-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7" acquired by "delete_volume" :: waited 0.013s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:27 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d20354-5a25-4abe-9482-a2c0aa3b8289]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:27 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 Jul 09 05:11:27 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:27 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6 1073741824" returned: 0 in 0.853s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:27 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6 Jul 09 05:11:27 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:27 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7" returned: 0 in 0.794s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:27 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7 Jul 09 05:11:27 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:28 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6" returned: 0 in 0.653s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b520b863-a658-4c7f-9b0a-30b7ea0ffc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde7c377-f2de-493d-914a-3b9a0b5891a6', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11e6abb-d0df-4580-9e92-5f8fd8ffea1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:28 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Volume volume-cde7c377-f2de-493d-914a-3b9a0b5891a6 (cde7c377-f2de-493d-914a-3b9a0b5891a6): created successfully Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11e6abb-d0df-4580-9e92-5f8fd8ffea1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Flow 'volume_create_manager' (089be8dc-eb5a-45c3-96d2-b70f9054fe09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:28 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6c4bb9fe-ee99-4bb2-9411-3950274c2aa1 tempest-ProjectReaderTests-1281412264 None] Created volume successfully. Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7" returned: 0 in 0.666s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Lock "cinder-quobyte-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7" released by "delete_volume" :: held 1.501s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Created reservations ['11f885d1-852f-4595-8eeb-13c8ea325f2e', 'ff561731-5ca0-4146-b120-a75efae62fb9', '806c4755-2bf6-4242-bb5e-a54c42ad1992', '854fb125-cc84-41ba-bf76-384d1ff4021f'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:28 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:28 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Acquiring lock "cinder-cde7c377-f2de-493d-914a-3b9a0b5891a6-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Lock "cinder-cde7c377-f2de-493d-914a-3b9a0b5891a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Acquiring lock "cinder-quobyte-cde7c377-f2de-493d-914a-3b9a0b5891a6" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Lock "cinder-quobyte-cde7c377-f2de-493d-914a-3b9a0b5891a6" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e875bce-7004-4010-8913-ac1e69a4bb50]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:29 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6 Jul 09 05:11:29 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:29 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.688s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Deleted volume successfully. Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0a57f178-2195-4583-840b-aaa86efe547e tempest-VolumesActionsTest-668727396 None] Lock "cinder-bf3218be-6bf8-40bb-834f-3ad5bf3e3bf7-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (e4937eaf-12b5-4ecd-81d5-53071c923b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8760ce9-d332-4a0a-9359-0b2bb6c97f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8760ce9-d332-4a0a-9359-0b2bb6c97f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-982393092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e033e6-9064-4d5b-9a1e-fed2c5a4618c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:30Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d55afa0-593d-4cfe-a7b0-6f36ae66f145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d55afa0-593d-4cfe-a7b0-6f36ae66f145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4dc27d-e775-440b-ba82-f8adfc41b75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4dc27d-e775-440b-ba82-f8adfc41b75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94e033e6-9064-4d5b-9a1e-fed2c5a4618c', 'volume_name': 'volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c1cb50-da04-438e-85da-23a1011d7e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c1cb50-da04-438e-85da-23a1011d7e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed609909-ccb5-411c-a929-89bd570a4382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:29 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Volume 94e033e6-9064-4d5b-9a1e-fed2c5a4618c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c', 'volume_size': 1} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-982393092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e033e6-9064-4d5b-9a1e-fed2c5a4618c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86b9ab591cb46fa9712189b2959f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:30Z,use_quota=True,user_id='5655c183be71452c8f1c8b49e7511237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Creating volume 94e033e6-9064-4d5b-9a1e-fed2c5a4618c {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:29 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:29 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c 1073741824 Jul 09 05:11:29 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:29 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6" returned: 0 in 0.837s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:29 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6 Jul 09 05:11:29 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:30 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cde7c377-f2de-493d-914a-3b9a0b5891a6" returned: 0 in 0.656s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Lock "cinder-quobyte-cde7c377-f2de-493d-914a-3b9a0b5891a6" released by "delete_volume" :: held 1.542s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=106,cinder:UPDATE=159,cinder:INSERT=29,cinder:DELETE=13 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Created reservations ['2b960cab-de85-46b9-b5dc-9ab72e9c0dc9', '4cd0382f-d8ca-4776-b40d-eebb901db318', '4888594d-bf22-4f41-a4b2-7792c7fd4040', 'acf50aba-41af-49b6-97f7-67ed0c4bc326'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:30 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c 1073741824" returned: 0 in 0.916s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:30 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:30 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:30 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c Jul 09 05:11:30 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:31 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c" returned: 0 in 0.650s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:31 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed609909-ccb5-411c-a929-89bd570a4382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8adcee09-881c-4f00-83b8-4767e143485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.723s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:31 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Deleted volume successfully. Jul 09 05:11:31 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Volume volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c (94e033e6-9064-4d5b-9a1e-fed2c5a4618c): created successfully Jul 09 05:11:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8adcee09-881c-4f00-83b8-4767e143485a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Flow 'volume_create_manager' (e4937eaf-12b5-4ecd-81d5-53071c923b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eca1345a-d2d8-471c-a324-66e188702846 tempest-ProjectReaderTests-1281412264 None] Lock "cinder-cde7c377-f2de-493d-914a-3b9a0b5891a6-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8f1679ab-b12b-40d8-afa4-6d0a39641ae5 tempest-VolumesActionsTest-1291639670 None] Created volume successfully. Jul 09 05:11:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "cinder-94e033e6-9064-4d5b-9a1e-fed2c5a4618c-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-94e033e6-9064-4d5b-9a1e-fed2c5a4618c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "cinder-quobyte-94e033e6-9064-4d5b-9a1e-fed2c5a4618c" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-quobyte-94e033e6-9064-4d5b-9a1e-fed2c5a4618c" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c536a0e5-a54b-437b-a40c-12ae69b09057]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:32 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c Jul 09 05:11:32 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:33 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c" returned: 0 in 0.808s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:33 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c Jul 09 05:11:33 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-f86d8054-c5bb-4bce-b3e6-7877b5a007be req-3b41aed4-61e0-4642-8be3-d1815a0568c3 tempest-TestStampPattern-894160609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-f86d8054-c5bb-4bce-b3e6-7877b5a007be req-3b41aed4-61e0-4642-8be3-d1815a0568c3 tempest-TestStampPattern-894160609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:33 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b0feb1-da08-4eff-9a9c-647e027aabc9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-f86d8054-c5bb-4bce-b3e6-7877b5a007be req-3b41aed4-61e0-4642-8be3-d1815a0568c3 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:33 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 Jul 09 05:11:33 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:34 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-94e033e6-9064-4d5b-9a1e-fed2c5a4618c" returned: 0 in 0.728s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-quobyte-94e033e6-9064-4d5b-9a1e-fed2c5a4618c" released by "delete_volume" :: held 1.589s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Created reservations ['e2c90c3b-89e5-4567-b2b4-eeb43ca1c979', '15a679c8-47da-4aac-8fc1-5dd5bc9d5653', '065fc75c-cf14-4269-a954-c3b8e51bb8b6', '6ffef5d3-0a93-4132-9ff3-91ee4092fe48'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:34 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-f86d8054-c5bb-4bce-b3e6-7877b5a007be req-3b41aed4-61e0-4642-8be3-d1815a0568c3 tempest-TestStampPattern-894160609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711" returned: 0 in 0.849s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-f86d8054-c5bb-4bce-b3e6-7877b5a007be req-3b41aed4-61e0-4642-8be3-d1815a0568c3 tempest-TestStampPattern-894160609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:34 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:34 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-f86d8054-c5bb-4bce-b3e6-7877b5a007be req-3b41aed4-61e0-4642-8be3-d1815a0568c3 tempest-TestStampPattern-894160609 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-bb953eab-3b90-49db-a00c-2906e3406711', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e8cbdf9-cd52-48ac-bcdf-ed2286471bc2', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:11:34 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-f86d8054-c5bb-4bce-b3e6-7877b5a007be req-3b41aed4-61e0-4642-8be3-d1815a0568c3 tempest-TestStampPattern-894160609 None] attachment_update completed successfully. Jul 09 05:11:34 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.685s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:34 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:34 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Deleted volume successfully. Jul 09 05:11:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d012eeee-fd86-405e-87fb-14b4f36718e7 tempest-VolumesActionsTest-1291639670 None] Lock "cinder-94e033e6-9064-4d5b-9a1e-fed2c5a4618c-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:39 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:11:39 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:39 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.669s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:11:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:11:43 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-1a10a3c0-e95f-4738-ab34-3001a18853a9 req-d84b027b-1cbd-48af-8412-ddf91ca4b3da tempest-TestStampPattern-894160609 None] Terminate volume connection completed successfully. Jul 09 05:11:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-1a10a3c0-e95f-4738-ab34-3001a18853a9 req-d84b027b-1cbd-48af-8412-ddf91ca4b3da tempest-TestStampPattern-894160609 None] Deleting attachment 0e8cbdf9-cd52-48ac-bcdf-ed2286471bc2. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Flow 'volume_create_manager' (8e3c5ba7-ff75-4d78-bc2b-c3a0801b205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c02928d-711e-4401-b49f-8a041fa43960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c02928d-711e-4401-b49f-8a041fa43960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-996645170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591809e6-9568-4d9f-bd7e-6b9db811932e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c784f980d4504e71ac6aef02ee9add78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:46Z,use_quota=True,user_id='b9fa19060f9448e49e511aed5366e72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e7998b-9063-46a1-a788-4cad84ecb967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e7998b-9063-46a1-a788-4cad84ecb967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f3493-7880-4971-beb3-adc70f5001ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f3493-7880-4971-beb3-adc70f5001ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591809e6-9568-4d9f-bd7e-6b9db811932e', 'volume_name': 'volume-591809e6-9568-4d9f-bd7e-6b9db811932e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df84939e-0abd-4d11-834f-e2aec75d6840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df84939e-0abd-4d11-834f-e2aec75d6840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8e62de-4fc6-460e-a216-b0895b953f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:45 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Volume 591809e6-9568-4d9f-bd7e-6b9db811932e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591809e6-9568-4d9f-bd7e-6b9db811932e', 'volume_size': 1} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-996645170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591809e6-9568-4d9f-bd7e-6b9db811932e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c784f980d4504e71ac6aef02ee9add78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:46Z,use_quota=True,user_id='b9fa19060f9448e49e511aed5366e72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Creating volume 591809e6-9568-4d9f-bd7e-6b9db811932e {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:45 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:45 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e 1073741824 Jul 09 05:11:45 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:46 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e 1073741824" returned: 0 in 0.820s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:46 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=101,cinder:INSERT=37,cinder:UPDATE=147,cinder:DELETE=13 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:11:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:46 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e Jul 09 05:11:46 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:47 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e" returned: 0 in 0.664s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.351s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8e62de-4fc6-460e-a216-b0895b953f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591809e6-9568-4d9f-bd7e-6b9db811932e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfbf76d-6c16-4b32-9d14-7f064a987cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Creating offline snapshot eb023ac6-5f03-4cba-9d0d-101680dbecd2 of volume bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:11:47 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Volume volume-591809e6-9568-4d9f-bd7e-6b9db811932e (591809e6-9568-4d9f-bd7e-6b9db811932e): created successfully Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfbf76d-6c16-4b32-9d14-7f064a987cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Flow 'volume_create_manager' (8e3c5ba7-ff75-4d78-bc2b-c3a0801b205a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[059a0151-e55a-4acf-ac58-22ffbaa2a14d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:47 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d54cd599-7962-45ac-9439-aa5a8f8255e4 tempest-VolumesListAdminTestJSON-842910682 None] Created volume successfully. Jul 09 05:11:47 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 Jul 09 05:11:47 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:48 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711" returned: 0 in 0.832s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:48 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 1G Jul 09 05:11:48 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Flow 'volume_create_manager' (77ca06ef-c85e-46d7-b2ff-59f6af0baef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3a22d6-7b4a-469b-ad1b-dd8f8b8baaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3a22d6-7b4a-469b-ad1b-dd8f8b8baaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-474746299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7791a6e9-de07-49e1-b801-a9de67c4b579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c784f980d4504e71ac6aef02ee9add78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:48Z,use_quota=True,user_id='b9fa19060f9448e49e511aed5366e72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fce3ee-1fa5-46b9-935a-1a35f21ea45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fce3ee-1fa5-46b9-935a-1a35f21ea45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e99e2fe-d0c7-4559-945a-e94afc51b9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e99e2fe-d0c7-4559-945a-e94afc51b9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7791a6e9-de07-49e1-b801-a9de67c4b579', 'volume_name': 'volume-7791a6e9-de07-49e1-b801-a9de67c4b579', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f376d056-ae70-4f79-8d59-6a7facd25feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f376d056-ae70-4f79-8d59-6a7facd25feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef098b3-8eb0-42ac-8b46-161d0d74895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:48 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Volume 7791a6e9-de07-49e1-b801-a9de67c4b579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7791a6e9-de07-49e1-b801-a9de67c4b579', 'volume_size': 1} Jul 09 05:11:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:49 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 1G" returned: 0 in 0.819s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb953eab-3b90-49db-a00c-2906e3406711 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:49 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb953eab-3b90-49db-a00c-2906e3406711 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 Jul 09 05:11:49 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:49 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb953eab-3b90-49db-a00c-2906e3406711 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2" returned: 0 in 0.688s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:49 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 is being set with open permissions: ugo+rw Jul 09 05:11:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:49 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 Jul 09 05:11:49 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:50 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2" returned: 0 in 0.644s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:50 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.info Jul 09 05:11:50 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:51 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.info" returned: 0 in 0.631s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:51 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.info is being set with open permissions: ugo+rw Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:51 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.info Jul 09 05:11:51 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:51 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.info" returned: 0 in 0.622s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.351s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.212s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-474746299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7791a6e9-de07-49e1-b801-a9de67c4b579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c784f980d4504e71ac6aef02ee9add78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:48Z,use_quota=True,user_id='b9fa19060f9448e49e511aed5366e72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Creating volume 7791a6e9-de07-49e1-b801-a9de67c4b579 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:51 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:51 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579 1073741824 Jul 09 05:11:51 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-06adf07a-ac31-4807-ad38-79dfc4793bc8 tempest-TestStampPattern-894160609 None] Create snapshot completed successfully Jul 09 05:11:52 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579 1073741824" returned: 0 in 0.812s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:52 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579 Jul 09 05:11:52 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:53 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579" returned: 0 in 0.642s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef098b3-8eb0-42ac-8b46-161d0d74895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7791a6e9-de07-49e1-b801-a9de67c4b579', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62268f78-1c77-4f05-b13e-0fec6538b59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:53 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Volume volume-7791a6e9-de07-49e1-b801-a9de67c4b579 (7791a6e9-de07-49e1-b801-a9de67c4b579): created successfully Jul 09 05:11:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62268f78-1c77-4f05-b13e-0fec6538b59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Flow 'volume_create_manager' (77ca06ef-c85e-46d7-b2ff-59f6af0baef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:53 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1bf29684-48a7-4360-a090-c49fa9548f04 tempest-VolumesListAdminTestJSON-842910682 None] Created volume successfully. Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Flow 'volume_create_manager' (a7de9446-191e-4a3c-94a1-48e42f1f8b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb4b896-8132-4b3d-8d82-55f28b7f8302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb4b896-8132-4b3d-8d82-55f28b7f8302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1130979071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5386b05-ee9f-4999-ba24-5334d84addb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c784f980d4504e71ac6aef02ee9add78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:54Z,use_quota=True,user_id='b9fa19060f9448e49e511aed5366e72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfbeaff-b60f-412e-9be7-a2ce66ea898f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfbeaff-b60f-412e-9be7-a2ce66ea898f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1520cf81-f326-4f0b-a76e-afce5dd62c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1520cf81-f326-4f0b-a76e-afce5dd62c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5386b05-ee9f-4999-ba24-5334d84addb4', 'volume_name': 'volume-d5386b05-ee9f-4999-ba24-5334d84addb4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792f83cc-6a29-4ade-a471-a1ad6fcd5a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792f83cc-6a29-4ade-a471-a1ad6fcd5a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1472fb63-4c78-4917-8337-0b351658a977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:54 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Volume d5386b05-ee9f-4999-ba24-5334d84addb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5386b05-ee9f-4999-ba24-5334d84addb4', 'volume_size': 1} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1130979071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5386b05-ee9f-4999-ba24-5334d84addb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c784f980d4504e71ac6aef02ee9add78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:54Z,use_quota=True,user_id='b9fa19060f9448e49e511aed5366e72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Creating volume d5386b05-ee9f-4999-ba24-5334d84addb4 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:54 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:54 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4 1073741824 Jul 09 05:11:54 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:55 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4 1073741824" returned: 0 in 0.796s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:55 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4 Jul 09 05:11:55 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:55 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4" returned: 0 in 0.667s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1472fb63-4c78-4917-8337-0b351658a977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5386b05-ee9f-4999-ba24-5334d84addb4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39599acf-d6bf-474a-8f08-225f6fed458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:55 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Volume volume-d5386b05-ee9f-4999-ba24-5334d84addb4 (d5386b05-ee9f-4999-ba24-5334d84addb4): created successfully Jul 09 05:11:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39599acf-d6bf-474a-8f08-225f6fed458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Flow 'volume_create_manager' (a7de9446-191e-4a3c-94a1-48e42f1f8b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:55 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-dcf8d9d1-65b0-4853-9400-86d0d61cde63 tempest-VolumesListAdminTestJSON-842910682 None] Created volume successfully. Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Flow 'volume_create_manager' (cdc36ae2-0f3c-4b20-8d92-24069a454f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5b5c77-4cf6-4428-b06d-e659a4bc503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5b5c77-4cf6-4428-b06d-e659a4bc503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df090054-9e9c-40f7-9a2c-1d0976fd63c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76ffc25f53e49a9accc51161f40b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:57Z,use_quota=True,user_id='7da3e8fa36bd4db1a1cb540a77dc5d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c313831-1174-4427-b78f-028b22bde11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c313831-1174-4427-b78f-028b22bde11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a809bedd-d84d-4683-bd97-1eb70bac3938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a809bedd-d84d-4683-bd97-1eb70bac3938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df090054-9e9c-40f7-9a2c-1d0976fd63c5', 'volume_name': 'volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c71159b-a4fb-43ae-a4f3-fc7c4e153e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c71159b-a4fb-43ae-a4f3-fc7c4e153e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0313303a-f6a2-4a06-97f4-7b8b620819e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Volume df090054-9e9c-40f7-9a2c-1d0976fd63c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5', 'volume_size': 1} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df090054-9e9c-40f7-9a2c-1d0976fd63c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76ffc25f53e49a9accc51161f40b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:11:57Z,use_quota=True,user_id='7da3e8fa36bd4db1a1cb540a77dc5d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Creating volume df090054-9e9c-40f7-9a2c-1d0976fd63c5 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:11:56 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:11:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:57 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5 1073741824 Jul 09 05:11:57 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:57 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5 1073741824" returned: 0 in 0.853s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:57 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5 Jul 09 05:11:57 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:58 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 09 05:11:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5" returned: 0 in 0.636s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:11:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:11:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:11:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0313303a-f6a2-4a06-97f4-7b8b620819e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd5c579-0d03-411c-ae1a-39eb1527b8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:11:58 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Volume volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5 (df090054-9e9c-40f7-9a2c-1d0976fd63c5): created successfully Jul 09 05:11:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd5c579-0d03-411c-ae1a-39eb1527b8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:11:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Flow 'volume_create_manager' (cdc36ae2-0f3c-4b20-8d92-24069a454f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:11:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-16e493a7-3136-4bb4-9682-a4d635c72af5 tempest-VolumesListAdminTestJSON-2004310382 None] Created volume successfully. Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Acquiring lock "cinder-df090054-9e9c-40f7-9a2c-1d0976fd63c5-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Lock "cinder-df090054-9e9c-40f7-9a2c-1d0976fd63c5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Acquiring lock "cinder-quobyte-df090054-9e9c-40f7-9a2c-1d0976fd63c5" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Lock "cinder-quobyte-df090054-9e9c-40f7-9a2c-1d0976fd63c5" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[791c7530-0c08-442d-bc00-6b1740e8311d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "cinder-d5386b05-ee9f-4999-ba24-5334d84addb4-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-d5386b05-ee9f-4999-ba24-5334d84addb4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "cinder-quobyte-d5386b05-ee9f-4999-ba24-5334d84addb4" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-quobyte-d5386b05-ee9f-4999-ba24-5334d84addb4" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:11:59 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5 Jul 09 05:11:59 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdef6c7-59ea-40d2-b1f1-062c9b906b39]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:11:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:11:59 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4 Jul 09 05:11:59 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:11:59 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5" returned: 0 in 0.852s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:00 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5 Jul 09 05:12:00 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:00 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4" returned: 0 in 0.867s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:00 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4 Jul 09 05:12:00 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:00 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-df090054-9e9c-40f7-9a2c-1d0976fd63c5" returned: 0 in 0.767s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Lock "cinder-quobyte-df090054-9e9c-40f7-9a2c-1d0976fd63c5" released by "delete_volume" :: held 1.670s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Created reservations ['2bfa2dfe-58a8-45cc-a62d-7064cc228061', 'f1bd0ead-4413-46f6-9aac-7f403f7f7595', '5555e873-d9fd-46cd-ab8d-a5488192dc13', 'ffef5cf9-938a-4e30-a248-0cf8e550b0f0'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:12:00 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d5386b05-ee9f-4999-ba24-5334d84addb4" returned: 0 in 0.683s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-quobyte-d5386b05-ee9f-4999-ba24-5334d84addb4" released by "delete_volume" :: held 1.599s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:00 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Created reservations ['ce02e598-be09-44d6-94b4-31f225d0b837', 'f031cf93-4424-4909-8bc4-2e899438529d', 'e63ea88a-cdec-49fc-9731-2b6c9731c41a', '2cef41fd-53a3-460a-8582-ec511486e68a'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:12:00 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:12:00 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:01 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:12:01 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "cinder-7791a6e9-de07-49e1-b801-a9de67c4b579-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-7791a6e9-de07-49e1-b801-a9de67c4b579-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "cinder-quobyte-7791a6e9-de07-49e1-b801-a9de67c4b579" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-quobyte-7791a6e9-de07-49e1-b801-a9de67c4b579" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50a9687-00a0-498f-b02b-ec184bc21300]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:01 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.751s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:12:01 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Deleted volume successfully. Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e05990da-5f40-4a5b-a279-4fda52c30ac5 tempest-VolumesListAdminTestJSON-2004310382 None] Lock "cinder-df090054-9e9c-40f7-9a2c-1d0976fd63c5-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:01 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.718s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:12:01 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Deleted volume successfully. Jul 09 05:12:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3ec7c470-37b7-41bc-a097-d0abb83a625d tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-d5386b05-ee9f-4999-ba24-5334d84addb4-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:01 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579 Jul 09 05:12:01 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Flow 'volume_create_manager' (9c8bfb4c-822c-40ee-9452-12c74a8a0ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651368aa-20e8-49bd-829b-0782eea8f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651368aa-20e8-49bd-829b-0782eea8f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1368903922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87fd8a69c97245a2a597fb05a8661592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb023ac6-5f03-4cba-9d0d-101680dbecd2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:12:02Z,use_quota=True,user_id='f77d0d1ca5dc454eb00693eb9febc985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a3a875-a4d7-4a10-b7a4-3803680aa3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a3a875-a4d7-4a10-b7a4-3803680aa3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb03e59-feb5-49eb-afc1-ba5ee868234e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb03e59-feb5-49eb-afc1-ba5ee868234e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2', 'volume_name': 'volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2', 'volume_size': 1, 'snapshot_id': 'eb023ac6-5f03-4cba-9d0d-101680dbecd2'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf821e4-2c9c-48bd-9beb-0fde1b9c116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf821e4-2c9c-48bd-9beb-0fde1b9c116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d09366-e718-4ef4-b4bb-d5f07b33fc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:02 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Volume 4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2', 'volume_size': 1, 'snapshot_id': 'eb023ac6-5f03-4cba-9d0d-101680dbecd2'} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Acquiring lock "cinder-quobyte-eb023ac6-5f03-4cba-9d0d-101680dbecd2-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" by "_create_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-eb023ac6-5f03-4cba-9d0d-101680dbecd2-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Creating volume 4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 from snapshot eb023ac6-5f03-4cba-9d0d-101680dbecd2 {{(pid=87161) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Acquiring lock "cinder-quobyte-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] snapshot: eb023ac6-5f03-4cba-9d0d-101680dbecd2, volume: 4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9f7c79-1f2b-4358-b3ff-e98212dbf8cd]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:02 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579" returned: 0 in 0.881s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:02 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579 Jul 09 05:12:02 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:02 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 Jul 09 05:12:02 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:03 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7791a6e9-de07-49e1-b801-a9de67c4b579" returned: 0 in 0.692s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-quobyte-7791a6e9-de07-49e1-b801-a9de67c4b579" released by "delete_volume" :: held 1.635s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Created reservations ['8e189307-03d7-4274-988f-cd80c71969be', '27a1d5ab-ac69-4708-9268-4dffbd89328a', '1f57b392-1f7c-4c86-a7b9-2e275a770822', 'ba1c7290-62b1-4e67-97f4-cc5404ee14e9'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:12:03 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2" returned: 0 in 0.902s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb953eab-3b90-49db-a00c-2906e3406711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d634cdfb-54ab-4b68-9a16-5f17c6ff8b86]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:03 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:12:03 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:03 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 Jul 09 05:12:03 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "cinder-591809e6-9568-4d9f-bd7e-6b9db811932e-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-591809e6-9568-4d9f-bd7e-6b9db811932e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "cinder-quobyte-591809e6-9568-4d9f-bd7e-6b9db811932e" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-quobyte-591809e6-9568-4d9f-bd7e-6b9db811932e" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:04 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7f717d-4bc6-4265-8acc-64c48d15c315]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:12:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:04 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e Jul 09 05:12:04 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:04 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.747s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:04 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:12:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Deleted volume successfully. Jul 09 05:12:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b1cd9da-49bc-4104-b616-ca0262631556 tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-7791a6e9-de07-49e1-b801-a9de67c4b579-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:04 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711" returned: 0 in 0.899s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:04 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:12:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:04 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 Jul 09 05:12:04 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:04 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e" returned: 0 in 0.859s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:04 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e Jul 09 05:12:04 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:05 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-591809e6-9568-4d9f-bd7e-6b9db811932e" returned: 0 in 0.946s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-quobyte-591809e6-9568-4d9f-bd7e-6b9db811932e" released by "delete_volume" :: held 1.886s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:05 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Created reservations ['bdc2a2fb-35ab-438f-8762-cc565515976e', '215f44d3-7ec1-42f5-8884-fc843078ecd5', 'cfc3d703-4cfb-4e66-bb47-b3a1b2e99982', '003d8b0d-317b-4163-acd3-a1c0d3f8702c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:12:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:06 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:12:06 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:07 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.735s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:07 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:12:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Deleted volume successfully. Jul 09 05:12:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f2e703cc-7eb5-4421-8fc6-7b98f1597ebf tempest-VolumesListAdminTestJSON-842910682 None] Lock "cinder-591809e6-9568-4d9f-bd7e-6b9db811932e-delete_volume" released by "delete_volume" :: held 4.112s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:10 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" returned: 0 in 5.991s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:10 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bd6d5a-f5ba-4cbc-8b06-248b857813d4]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:12:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:10 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 Jul 09 05:12:10 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:11 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711" returned: 0 in 1.254s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:11 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:12:11 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Converted 1024.00 MB image at 170.89 MB/s Jul 09 05:12:11 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 is being set with open permissions: ugo+rw Jul 09 05:12:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:11 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 Jul 09 05:12:11 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:12 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" returned: 0 in 0.911s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" released by "_copy_volume_from_snapshot" :: held 10.117s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-eb023ac6-5f03-4cba-9d0d-101680dbecd2-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" released by "_create_volume_from_snapshot" :: held 10.158s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.176s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d09366-e718-4ef4-b4bb-d5f07b33fc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2', 'volume_size': 1, 'snapshot_id': 'eb023ac6-5f03-4cba-9d0d-101680dbecd2'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15becb0e-acfd-46b2-b539-cd013ddbe248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:12 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Volume volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 (4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2): created successfully Jul 09 05:12:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15becb0e-acfd-46b2-b539-cd013ddbe248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Flow 'volume_create_manager' (9c8bfb4c-822c-40ee-9452-12c74a8a0ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:12:12 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8ef3b55d-0119-410e-ba59-91c6b72ee9b3 tempest-TestStampPattern-894160609 None] Created volume successfully. Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Flow 'volume_create_manager' (4a091400-64c2-4a04-8f61-741330f9495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610b3c99-0a91-4018-9e1d-8bf75a9ecbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610b3c99-0a91-4018-9e1d-8bf75a9ecbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1893053260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a024e3-8033-44a6-a599-f257c49f8ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61fd52d06584417bd3a8c9d0c107ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:12:15Z,use_quota=True,user_id='64f525ef54ff47deacfc35de239298a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540a4f07-1d48-46a9-b354-16fd036ff368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540a4f07-1d48-46a9-b354-16fd036ff368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fdffbe-29ed-4831-a11b-c1580afaeb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fdffbe-29ed-4831-a11b-c1580afaeb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75a024e3-8033-44a6-a599-f257c49f8ae7', 'volume_name': 'volume-75a024e3-8033-44a6-a599-f257c49f8ae7', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711fd0a5-25a3-4c34-a221-28f554ef0790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711fd0a5-25a3-4c34-a221-28f554ef0790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a717f24-534a-4bbb-8ceb-42daf2eff435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:15 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Volume 75a024e3-8033-44a6-a599-f257c49f8ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75a024e3-8033-44a6-a599-f257c49f8ae7', 'volume_size': 1} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1893053260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a024e3-8033-44a6-a599-f257c49f8ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61fd52d06584417bd3a8c9d0c107ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:12:15Z,use_quota=True,user_id='64f525ef54ff47deacfc35de239298a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Creating volume 75a024e3-8033-44a6-a599-f257c49f8ae7 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:12:15 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:12:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:15 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7 1073741824 Jul 09 05:12:15 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:16 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7 1073741824" returned: 0 in 0.991s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:16 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7 Jul 09 05:12:16 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:17 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7" returned: 0 in 0.667s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:12:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a717f24-534a-4bbb-8ceb-42daf2eff435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a024e3-8033-44a6-a599-f257c49f8ae7', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e534b13f-bfb0-49a5-8364-4212ebf95d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:17 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Volume volume-75a024e3-8033-44a6-a599-f257c49f8ae7 (75a024e3-8033-44a6-a599-f257c49f8ae7): created successfully Jul 09 05:12:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e534b13f-bfb0-49a5-8364-4212ebf95d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Flow 'volume_create_manager' (4a091400-64c2-4a04-8f61-741330f9495c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:12:17 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-bc1b443d-9a59-4182-bb4a-fc3a6f0a6540 tempest-VolumesTransfersTest-1451087150 None] Created volume successfully. Jul 09 05:12:17 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-88740ae7-97f4-4e8f-8f52-b6397450313d tempest-VolumesTransfersTest-318103907 None] Transfer volume completed successfully. Jul 09 05:12:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Acquiring lock "cinder-75a024e3-8033-44a6-a599-f257c49f8ae7-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Lock "cinder-75a024e3-8033-44a6-a599-f257c49f8ae7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Acquiring lock "cinder-quobyte-75a024e3-8033-44a6-a599-f257c49f8ae7" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Lock "cinder-quobyte-75a024e3-8033-44a6-a599-f257c49f8ae7" acquired by "delete_volume" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:19 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[281adbbd-51f8-4c12-a4ec-78ef40633964]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:12:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:19 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7 Jul 09 05:12:19 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:19 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7" returned: 0 in 0.780s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:19 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7 Jul 09 05:12:19 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:20 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-75a024e3-8033-44a6-a599-f257c49f8ae7" returned: 0 in 0.674s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Lock "cinder-quobyte-75a024e3-8033-44a6-a599-f257c49f8ae7" released by "delete_volume" :: held 1.506s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:20 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Created reservations ['d2b96d05-050e-4371-8b24-928cb5225de1', '2346bc20-df92-4f54-a032-b2d4cfdc6066', 'ee8551f0-fa0d-4bf8-96eb-39f2efd60d6c', '1149f889-62f6-4f08-a4d0-c8bc9afda68c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:12:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:20 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:12:20 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:21 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.698s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:12:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Deleted volume successfully. Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3b582f89-b337-4db9-9824-edecdbff6991 tempest-VolumesTransfersTest-1543883900 None] Lock "cinder-75a024e3-8033-44a6-a599-f257c49f8ae7-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Flow 'volume_create_manager' (899120e4-0bff-42bf-bc81-b6708785ceae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbbe4da-d4e9-4305-9b15-940abc40fa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbbe4da-d4e9-4305-9b15-940abc40fa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-334003518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce18af61-054c-4c57-a474-afd4d08e3898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61fd52d06584417bd3a8c9d0c107ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:12:22Z,use_quota=True,user_id='64f525ef54ff47deacfc35de239298a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd32ff2a-b5da-4ca2-aed4-2c7910cb8edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd32ff2a-b5da-4ca2-aed4-2c7910cb8edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818d6645-73ed-4caa-bacc-2a42b6f9f074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818d6645-73ed-4caa-bacc-2a42b6f9f074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce18af61-054c-4c57-a474-afd4d08e3898', 'volume_name': 'volume-ce18af61-054c-4c57-a474-afd4d08e3898', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8c9338-5633-47ea-b99b-2493b2f65ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8c9338-5633-47ea-b99b-2493b2f65ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c1dbb3-2412-424c-82a7-9357a042b4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:21 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Volume ce18af61-054c-4c57-a474-afd4d08e3898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce18af61-054c-4c57-a474-afd4d08e3898', 'volume_size': 1} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-334003518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce18af61-054c-4c57-a474-afd4d08e3898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61fd52d06584417bd3a8c9d0c107ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:12:22Z,use_quota=True,user_id='64f525ef54ff47deacfc35de239298a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Creating volume ce18af61-054c-4c57-a474-afd4d08e3898 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:12:21 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:12:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:22 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898 1073741824 Jul 09 05:12:22 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:22 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898 1073741824" returned: 0 in 1.010s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:23 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898 Jul 09 05:12:23 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:23 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898" returned: 0 in 0.681s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:12:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c1dbb3-2412-424c-82a7-9357a042b4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce18af61-054c-4c57-a474-afd4d08e3898', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da693f7b-da0b-479e-b128-84bbeed55d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:23 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Volume volume-ce18af61-054c-4c57-a474-afd4d08e3898 (ce18af61-054c-4c57-a474-afd4d08e3898): created successfully Jul 09 05:12:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da693f7b-da0b-479e-b128-84bbeed55d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Flow 'volume_create_manager' (899120e4-0bff-42bf-bc81-b6708785ceae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:12:23 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3d33e001-1578-4c8b-9efd-29f85fae0339 tempest-VolumesTransfersTest-1451087150 None] Created volume successfully. Jul 09 05:12:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Acquiring lock "cinder-ce18af61-054c-4c57-a474-afd4d08e3898-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Lock "cinder-ce18af61-054c-4c57-a474-afd4d08e3898-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Acquiring lock "cinder-quobyte-ce18af61-054c-4c57-a474-afd4d08e3898" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Lock "cinder-quobyte-ce18af61-054c-4c57-a474-afd4d08e3898" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:24 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a70f219-1c4e-47cd-a2e9-356417397eab]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:12:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:24 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898 Jul 09 05:12:24 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:25 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898" returned: 0 in 0.806s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:25 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898 Jul 09 05:12:25 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:25 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ce18af61-054c-4c57-a474-afd4d08e3898" returned: 0 in 0.681s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Lock "cinder-quobyte-ce18af61-054c-4c57-a474-afd4d08e3898" released by "delete_volume" :: held 1.524s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:25 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Created reservations ['54b0321d-8776-4470-a3ab-b789005e0efa', '53a8aefa-f8a8-4c55-9324-bd7af0dce284', '749831d0-546d-443c-b5d9-6c03a2a67835', '98ae957e-baf2-44ac-a9a5-b826dd133f92'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:12:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:26 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:12:26 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:26 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.660s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:26 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:12:26 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Deleted volume successfully. Jul 09 05:12:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f28d08b5-7be2-426f-89f2-acecadee93cc tempest-VolumesTransfersTest-1543883900 None] Lock "cinder-ce18af61-054c-4c57-a474-afd4d08e3898-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:36 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:INSERT=17,cinder:UPDATE=86,cinder:SELECT=71,cinder:DELETE=10 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:12:36 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=43,cinder:UPDATE=67,cinder:DELETE=5,cinder:INSERT=18 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:39 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:12:39 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:39 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.708s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:12:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Flow 'volume_create_manager' (2900bf48-6aca-4e94-9819-f210f1b7635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a4e17a-a4b3-41bc-b3ae-8fca2d699117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a4e17a-a4b3-41bc-b3ae-8fca2d699117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1368342822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7e8131-e9ab-4476-8fe4-4b99d494672e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42464319cb4f4ca7ad0581c2836dce6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:12:40Z,use_quota=True,user_id='c1f8788a89a24e76a483d7181e53d4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc22950-b422-40c9-8e81-d84471be5c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc22950-b422-40c9-8e81-d84471be5c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f5eaff-e782-4d8a-9b02-bf225e4087ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f5eaff-e782-4d8a-9b02-bf225e4087ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7e8131-e9ab-4476-8fe4-4b99d494672e', 'volume_name': 'volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a79c215-0c4e-4e1c-830f-130d6d7db551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a79c215-0c4e-4e1c-830f-130d6d7db551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1d9a34-38e0-4722-bd96-824eb793a38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:40 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Volume ae7e8131-e9ab-4476-8fe4-4b99d494672e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e', 'volume_size': 1} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1368342822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7e8131-e9ab-4476-8fe4-4b99d494672e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42464319cb4f4ca7ad0581c2836dce6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:12:40Z,use_quota=True,user_id='c1f8788a89a24e76a483d7181e53d4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Creating volume ae7e8131-e9ab-4476-8fe4-4b99d494672e {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:12:40 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:12:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:40 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e 1073741824 Jul 09 05:12:40 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:41 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e 1073741824" returned: 0 in 0.827s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:41 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e Jul 09 05:12:41 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:42 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e" returned: 0 in 0.640s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:12:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1d9a34-38e0-4722-bd96-824eb793a38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ddae6c-662d-4362-95bb-73a61584d14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:12:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Volume volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e (ae7e8131-e9ab-4476-8fe4-4b99d494672e): created successfully Jul 09 05:12:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ddae6c-662d-4362-95bb-73a61584d14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:12:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Flow 'volume_create_manager' (2900bf48-6aca-4e94-9819-f210f1b7635b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:12:42 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ec718fe9-8742-4e55-8b6d-7596fcc82a43 tempest-VolumesActionsTest-239293563 None] Created volume successfully. Jul 09 05:12:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ac0dcac4-5a2e-4c24-90f6-9fee45543a7b req-445be812-64cd-428d-945a-1f62c9d13fd6 tempest-TestStampPattern-894160609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:12:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ac0dcac4-5a2e-4c24-90f6-9fee45543a7b req-445be812-64cd-428d-945a-1f62c9d13fd6 tempest-TestStampPattern-894160609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:12:48 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a4964c-c077-4762-b090-68fed93b30a7]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:12:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ac0dcac4-5a2e-4c24-90f6-9fee45543a7b req-445be812-64cd-428d-945a-1f62c9d13fd6 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:12:48 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 Jul 09 05:12:48 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:12:49 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 09 05:12:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ac0dcac4-5a2e-4c24-90f6-9fee45543a7b req-445be812-64cd-428d-945a-1f62c9d13fd6 tempest-TestStampPattern-894160609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" returned: 0 in 0.886s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:12:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ac0dcac4-5a2e-4c24-90f6-9fee45543a7b req-445be812-64cd-428d-945a-1f62c9d13fd6 tempest-TestStampPattern-894160609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:12:49 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-ac0dcac4-5a2e-4c24-90f6-9fee45543a7b req-445be812-64cd-428d-945a-1f62c9d13fd6 tempest-TestStampPattern-894160609 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ae84419-7039-4ead-852b-8b8eae2b098b', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:12:49 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-ac0dcac4-5a2e-4c24-90f6-9fee45543a7b req-445be812-64cd-428d-945a-1f62c9d13fd6 tempest-TestStampPattern-894160609 None] attachment_update completed successfully. Jul 09 05:12:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5fca9663-5306-494d-8728-1c0b2719b153 tempest-VolumesActionsTest-239293563 None] Acquiring lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e" by "attach_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5fca9663-5306-494d-8728-1c0b2719b153 tempest-VolumesActionsTest-239293563 None] Lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e" acquired by "attach_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:57 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5fca9663-5306-494d-8728-1c0b2719b153 tempest-VolumesActionsTest-239293563 None] Attaching volume ae7e8131-e9ab-4476-8fe4-4b99d494672e to instance 8049e796-4432-43e0-a8d5-892cf9ab000f at mountpoint /dev/vdb on host None. Jul 09 05:12:57 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5fca9663-5306-494d-8728-1c0b2719b153 tempest-VolumesActionsTest-239293563 None] Attach volume completed successfully. Jul 09 05:12:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5fca9663-5306-494d-8728-1c0b2719b153 tempest-VolumesActionsTest-239293563 None] Lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e" released by "attach_volume" :: held 0.148s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:12:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-6f54a862-4293-4215-9efd-b7ea368f1542 req-099376d2-5de2-43cb-898d-3b027ddc0e44 tempest-TestStampPattern-894160609 None] Terminate volume connection completed successfully. Jul 09 05:12:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6f54a862-4293-4215-9efd-b7ea368f1542 req-099376d2-5de2-43cb-898d-3b027ddc0e44 tempest-TestStampPattern-894160609 None] Deleting attachment 9ae84419-7039-4ead-852b-8b8eae2b098b. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:12:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8147fa3a-4ad6-4eba-afcb-4d7744023fa2 tempest-VolumesActionsTest-239293563 None] Acquiring lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e-detach_volume" by "detach_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:12:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8147fa3a-4ad6-4eba-afcb-4d7744023fa2 tempest-VolumesActionsTest-239293563 None] Lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:12:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8147fa3a-4ad6-4eba-afcb-4d7744023fa2 tempest-VolumesActionsTest-239293563 None] Detaching volume ae7e8131-e9ab-4476-8fe4-4b99d494672e from instance 8049e796-4432-43e0-a8d5-892cf9ab000f. Jul 09 05:12:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8147fa3a-4ad6-4eba-afcb-4d7744023fa2 tempest-VolumesActionsTest-239293563 None] Detach volume completed successfully. Jul 09 05:12:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8147fa3a-4ad6-4eba-afcb-4d7744023fa2 tempest-VolumesActionsTest-239293563 None] Lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:13:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Acquiring lock "cinder-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:13:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Lock "cinder-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:13:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Acquiring lock "cinder-quobyte-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:13:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:13:08 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0617244-7a29-457d-b684-e8221caf4457]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:13:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:08 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 Jul 09 05:13:08 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:09 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" returned: 0 in 0.771s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:09 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2 Jul 09 05:13:09 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:10 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" returned: 0 in 0.625s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2" released by "delete_volume" :: held 1.435s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Created reservations ['fec89262-6139-431b-801f-bc5cf2dc2cf0', 'c80ae66a-b196-4310-9c06-d43f9b3d9468', 'bf7a7f00-7045-4c8d-a794-682677299fa3', '852f599b-8f21-4d42-b248-12ad83fc4f72'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:10 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:13:10 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:10 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.688s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:13:10 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Deleted volume successfully. Jul 09 05:13:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c97f98e7-9f90-4398-a38c-c8ed3ec4dfea tempest-TestStampPattern-894160609 None] Lock "cinder-4eb2f9a1-2df6-4c70-a6b4-d1ea33dfe2d2-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Acquiring lock "cinder-eb023ac6-5f03-4cba-9d0d-101680dbecd2-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Lock "cinder-eb023ac6-5f03-4cba-9d0d-101680dbecd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Acquiring lock "cinder-quobyte-bb953eab-3b90-49db-a00c-2906e3406711" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-bb953eab-3b90-49db-a00c-2906e3406711" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Acquiring lock "cinder-quobyte-eb023ac6-5f03-4cba-9d0d-101680dbecd2" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-eb023ac6-5f03-4cba-9d0d-101680dbecd2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Deleting offline snapshot eb023ac6-5f03-4cba-9d0d-101680dbecd2 of volume bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] snapshot_file for this snap is: volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4e3833-f29e-45a3-a0f6-5dc5f3913700]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:11 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 Jul 09 05:13:11 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:11 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2" returned: 0 in 0.805s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb953eab-3b90-49db-a00c-2906e3406711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc92a90-bfb9-4629-99a0-2a2e7a431ac3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:13:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:12 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 Jul 09 05:13:12 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:12 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711" returned: 0 in 0.835s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:12 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 Jul 09 05:13:12 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:13 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2" returned: 0 in 0.791s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:13 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2 Jul 09 05:13:13 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:14 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711.eb023ac6-5f03-4cba-9d0d-101680dbecd2" returned: 0 in 0.722s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-eb023ac6-5f03-4cba-9d0d-101680dbecd2" released by "_delete_snapshot" :: held 3.281s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:13:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-bb953eab-3b90-49db-a00c-2906e3406711" released by "delete_snapshot" :: held 3.302s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:13:14 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Created reservations ['bca423dc-fda5-4a0c-b4d0-f4f9e59754bf', 'a7d98024-b5f2-4e39-88d2-7f6562a5d59b', 'c8d09016-105e-4cee-9db7-8c5c63810713', '6c437ace-ab3d-4066-ba61-7eddae172eb4'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:13:14 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Delete snapshot completed successfully. Jul 09 05:13:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6c311d70-88ce-49e6-8de0-275e37576843 tempest-TestStampPattern-894160609 None] Lock "cinder-eb023ac6-5f03-4cba-9d0d-101680dbecd2-delete_snapshot" released by "delete_snapshot" :: held 3.499s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:13:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0dfcf839-1a63-40dd-bdb1-c53d6f79aa5e tempest-VolumesActionsTest-239293563 None] Acquiring lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e" by "attach_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0dfcf839-1a63-40dd-bdb1-c53d6f79aa5e tempest-VolumesActionsTest-239293563 None] Lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e" acquired by "attach_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:13:22 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0dfcf839-1a63-40dd-bdb1-c53d6f79aa5e tempest-VolumesActionsTest-239293563 None] Attaching volume ae7e8131-e9ab-4476-8fe4-4b99d494672e to instance c526c4af-e96b-4c58-8e25-4abbffc2c1f8 at mountpoint /dev/vdb on host None. Jul 09 05:13:22 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0dfcf839-1a63-40dd-bdb1-c53d6f79aa5e tempest-VolumesActionsTest-239293563 None] Attach volume completed successfully. Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0dfcf839-1a63-40dd-bdb1-c53d6f79aa5e tempest-VolumesActionsTest-239293563 None] Lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e" released by "attach_volume" :: held 0.098s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Acquiring lock "cinder-bb953eab-3b90-49db-a00c-2906e3406711-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Lock "cinder-bb953eab-3b90-49db-a00c-2906e3406711-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Acquiring lock "cinder-quobyte-bb953eab-3b90-49db-a00c-2906e3406711" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-bb953eab-3b90-49db-a00c-2906e3406711" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeba5a42-8215-46d4-adab-ea1050d04e2f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8fa3cf58-9a4b-490a-9098-aff0d195f5cc tempest-VolumesActionsTest-239293563 None] Acquiring lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e-detach_volume" by "detach_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8fa3cf58-9a4b-490a-9098-aff0d195f5cc tempest-VolumesActionsTest-239293563 None] Lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:13:22 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8fa3cf58-9a4b-490a-9098-aff0d195f5cc tempest-VolumesActionsTest-239293563 None] Detaching volume ae7e8131-e9ab-4476-8fe4-4b99d494672e from instance c526c4af-e96b-4c58-8e25-4abbffc2c1f8. Jul 09 05:13:22 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 Jul 09 05:13:22 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:22 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8fa3cf58-9a4b-490a-9098-aff0d195f5cc tempest-VolumesActionsTest-239293563 None] Detach volume completed successfully. Jul 09 05:13:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8fa3cf58-9a4b-490a-9098-aff0d195f5cc tempest-VolumesActionsTest-239293563 None] Lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e-detach_volume" released by "detach_volume" :: held 0.061s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:13:23 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711" returned: 0 in 0.896s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:23 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711 Jul 09 05:13:23 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:24 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-bb953eab-3b90-49db-a00c-2906e3406711" returned: 0 in 0.694s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Lock "cinder-quobyte-bb953eab-3b90-49db-a00c-2906e3406711" released by "delete_volume" :: held 1.657s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:13:24 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Created reservations ['563fd13e-8107-4cb5-b122-171075f05cc3', '79f4b5e1-0a11-4394-b911-7e075ca44fcf', '9be6aa4b-6532-4c7e-bc30-06e6798f655b', '59006fce-17e6-497e-a7b2-2584b75be839'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:13:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:13:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:13:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:13:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:13:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:13:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:24 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:13:24 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:25 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.674s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:25 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:13:25 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Deleted volume successfully. Jul 09 05:13:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8753f089-03d8-4c73-beb6-834fba6ec4db tempest-TestStampPattern-894160609 None] Lock "cinder-bb953eab-3b90-49db-a00c-2906e3406711-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:13:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:13:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:13:31 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f98adf7-41b3-4dbb-a755-aac882c0c659]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:13:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:31 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e Jul 09 05:13:31 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:32 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e" returned: 0 in 0.788s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd779ed-633c-4f50-b1c0-de6e536b1c26]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:13:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:32 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e Jul 09 05:13:32 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:33 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e" returned: 0 in 0.804s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.6242d917-e3af-4ca7-8b58-c11ed0856f86b_1_3738.img {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:33 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.6242d917-e3af-4ca7-8b58-c11ed0856f86b_1_3738.img Jul 09 05:13:33 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:34 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=36,cinder:UPDATE=36,cinder:DELETE=1,cinder:INSERT=7 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:13:38 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.6242d917-e3af-4ca7-8b58-c11ed0856f86b_1_3738.img" returned: 0 in 5.029s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec62481-ded0-4785-ad77-8dc9df142107]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:38 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e Jul 09 05:13:38 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=30,cinder:SELECT=40,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Flow 'volume_create_manager' (d2de5538-43a7-4b59-bc1b-7e5fbd35e9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40ee251-3f57-47e8-9eff-e6729e1b7bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40ee251-3f57-47e8-9eff-e6729e1b7bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1693994572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7316a09-90f3-483f-b0cf-a2c9d05b75a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a23f5983054795919764e86dbd6af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:13:38Z,use_quota=True,user_id='2b90dac4210d46f39225d797f92d1f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e3a272-22a6-4f03-8af1-0fb029ec8913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e3a272-22a6-4f03-8af1-0fb029ec8913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5803bed-fd82-49b7-ad7f-e133ff276c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5803bed-fd82-49b7-ad7f-e133ff276c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7316a09-90f3-483f-b0cf-a2c9d05b75a1', 'volume_name': 'volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed823880-242b-4ac3-82e5-01c04adbc8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed823880-242b-4ac3-82e5-01c04adbc8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19bedcc9-2c07-4e08-9a58-6f1e8e92242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:13:38 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Volume f7316a09-90f3-483f-b0cf-a2c9d05b75a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1', 'volume_size': 1} Jul 09 05:13:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:13:39 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e" returned: 0 in 0.936s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.6242d917-e3af-4ca7-8b58-c11ed0856f86b_1_3738.img {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:13:39 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Converted 1024.00 MB image at 203.60 MB/s Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] 6242d917-e3af-4ca7-8b58-c11ed0856f86 was raw, no need to convert to raw {{(pid=87161) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:39 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:13:39 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:39 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.652s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:13:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:13:49 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:13:49 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=3 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.282s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Uploaded volume to glance image-id: 6242d917-e3af-4ca7-8b58-c11ed0856f86. {{(pid=87161) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.403s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1693994572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7316a09-90f3-483f-b0cf-a2c9d05b75a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a23f5983054795919764e86dbd6af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:13:38Z,use_quota=True,user_id='2b90dac4210d46f39225d797f92d1f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Creating volume f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:13:57 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:13:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:57 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 1073741824 Jul 09 05:13:57 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-035e706c-1803-459d-996b-2201cefe9dfe tempest-VolumesActionsTest-239293563 None] Copy volume to image completed successfully. Jul 09 05:13:57 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:58 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 1073741824" returned: 0 in 0.847s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:58 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 Jul 09 05:13:58 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:59 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" returned: 0 in 0.626s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19bedcc9-2c07-4e08-9a58-6f1e8e92242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a384609-a44e-4759-9feb-bbd04222205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:13:59 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Volume volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 (f7316a09-90f3-483f-b0cf-a2c9d05b75a1): created successfully Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a384609-a44e-4759-9feb-bbd04222205d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Flow 'volume_create_manager' (d2de5538-43a7-4b59-bc1b-7e5fbd35e9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:13:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4ce3b8ea-f7f0-4eb8-8058-325e0ff406dd tempest-VolumeDependencyTests-1238463760 None] Created volume successfully. Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7f890b-0f27-4d44-9a88-7de034cf9607]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:13:59 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e Jul 09 05:13:59 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:13:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:00 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e" returned: 0 in 0.798s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:00 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd28919-089c-45f9-bf56-2f5256f293c0]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:00 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e Jul 09 05:14:00 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:01 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e" returned: 0 in 0.770s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:01 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img Jul 09 05:14:01 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:05 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img" returned: 0 in 4.211s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:05 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fbc064-14be-412c-aa0e-63d4dc10b06f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:05 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e Jul 09 05:14:05 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:06 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e" returned: 0 in 0.887s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:06 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:14:06 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Converted 1024.00 MB image at 243.08 MB/s Jul 09 05:14:06 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] 1362caec-85a1-4e69-a0d5-e42d8eacb127 was raw, converting to qcow2 {{(pid=87161) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 05:14:06 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[43067872-2034-4cbc-ae7c-37414590b9aa]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:06 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img Jul 09 05:14:06 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:06 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img" returned: 0 in 0.708s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:06 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img Jul 09 05:14:06 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:07 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img" returned: 1 in 0.713s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:14:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img /opt/stack/data/cinder/conversion/vol_upload_ad55uadr {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:07 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img /opt/stack/data/cinder/conversion/vol_upload_ad55uadr Jul 09 05:14:07 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:08 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img /opt/stack/data/cinder/conversion/vol_upload_ad55uadr" returned: 0 in 0.655s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:08 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Image conversion details: src /opt/stack/data/cinder/conversion/ae7e8131-e9ab-4476-8fe4-4b99d494672e.temp_image.1362caec-85a1-4e69-a0d5-e42d8eacb12781woy4or.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ad55uadr {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:14:08 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 09 05:14:08 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[09890e42-a41f-4e82-bcd1-66e4c76211c4]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ad55uadr {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:08 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ad55uadr Jul 09 05:14:08 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:08 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ad55uadr" returned: 0 in 0.722s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:09 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:14:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.830s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Uploaded volume to glance image-id: 1362caec-85a1-4e69-a0d5-e42d8eacb127. {{(pid=87161) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 05:14:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.518s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Creating offline snapshot a14fdbaf-4785-467d-a198-81ea160e00ce of volume f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:14:10 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-29c9974c-92db-40b8-afce-fba8898efc90 tempest-VolumesActionsTest-239293563 None] Copy volume to image completed successfully. Jul 09 05:14:10 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d212f594-abe3-44a6-840a-b2cbd04bfbee]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:10 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 Jul 09 05:14:10 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:11 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" returned: 0 in 0.748s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:11 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce 1G Jul 09 05:14:11 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Acquiring lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Acquiring lock "cinder-quobyte-ae7e8131-e9ab-4476-8fe4-4b99d494672e" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Lock "cinder-quobyte-ae7e8131-e9ab-4476-8fe4-4b99d494672e" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:11 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde6319-ebe4-4d77-ac25-a28d21cc5365]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:11 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e Jul 09 05:14:11 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:11 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce 1G" returned: 0 in 0.877s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:11 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce Jul 09 05:14:11 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:12 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e" returned: 0 in 0.777s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:12 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e Jul 09 05:14:12 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:12 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce" returned: 0 in 0.715s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:12 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce is being set with open permissions: ugo+rw Jul 09 05:14:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:12 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce Jul 09 05:14:12 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:13 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ae7e8131-e9ab-4476-8fe4-4b99d494672e" returned: 0 in 0.677s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Lock "cinder-quobyte-ae7e8131-e9ab-4476-8fe4-4b99d494672e" released by "delete_volume" :: held 1.493s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Created reservations ['ed3f1eca-2312-48ee-a645-fbe110ca0cea', '6b9e9395-e50f-4974-bc6d-d036f59246bc', '96f20155-785b-430e-b521-1f1697a1fa54', 'c2fafc8d-8c84-43c5-aa89-acc5bb7af37e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:13 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:14:13 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:13 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce" returned: 0 in 0.704s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:13 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.info Jul 09 05:14:13 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:13 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.650s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:14:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Deleted volume successfully. Jul 09 05:14:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-dec93302-f357-476e-948c-0f5426a4b0de tempest-VolumesActionsTest-239293563 None] Lock "cinder-ae7e8131-e9ab-4476-8fe4-4b99d494672e-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:14 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.info" returned: 0 in 0.696s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:14 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.info is being set with open permissions: ugo+rw Jul 09 05:14:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:14 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.info Jul 09 05:14:14 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:14 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.info" returned: 0 in 0.721s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.554s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:14 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-01402a40-258d-4d08-843c-48cce3b473f5 tempest-VolumeDependencyTests-1238463760 None] Create snapshot completed successfully Jul 09 05:14:15 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Flow 'volume_create_manager' (12b4940e-d146-48b5-8440-81c9ead0b2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac948f3-e834-4bf7-ad03-d5e3311b17d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac948f3-e834-4bf7-ad03-d5e3311b17d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-864243218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b28fcbd-9543-40fd-9e2e-ac5c300f38dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a23f5983054795919764e86dbd6af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a14fdbaf-4785-467d-a198-81ea160e00ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:14:16Z,use_quota=True,user_id='2b90dac4210d46f39225d797f92d1f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0b1199-f015-4708-ba7c-9950f9770a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0b1199-f015-4708-ba7c-9950f9770a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12bdb17-c376-4b65-9863-b8d41c651c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12bdb17-c376-4b65-9863-b8d41c651c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b28fcbd-9543-40fd-9e2e-ac5c300f38dd', 'volume_name': 'volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd', 'volume_size': 1, 'snapshot_id': 'a14fdbaf-4785-467d-a198-81ea160e00ce'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac01ea0-3217-4928-a6de-dda0dacd0c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac01ea0-3217-4928-a6de-dda0dacd0c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5e6303-1162-4d3f-b245-8e345960c2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:16 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Volume 8b28fcbd-9543-40fd-9e2e-ac5c300f38dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd', 'volume_size': 1, 'snapshot_id': 'a14fdbaf-4785-467d-a198-81ea160e00ce'} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "cinder-quobyte-a14fdbaf-4785-467d-a198-81ea160e00ce-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" by "_create_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-a14fdbaf-4785-467d-a198-81ea160e00ce-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Creating volume 8b28fcbd-9543-40fd-9e2e-ac5c300f38dd from snapshot a14fdbaf-4785-467d-a198-81ea160e00ce {{(pid=87161) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "cinder-quobyte-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] snapshot: a14fdbaf-4785-467d-a198-81ea160e00ce, volume: 8b28fcbd-9543-40fd-9e2e-ac5c300f38dd, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af8fc7-d507-45d7-ba40-79e7c06ffae5]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:16 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce Jul 09 05:14:16 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:17 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce" returned: 0 in 0.867s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:14:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:14:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:14:17 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdf0488-b58d-4126-9174-99df9e54c823]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:17 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 Jul 09 05:14:17 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:17 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" returned: 0 in 0.850s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:17 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:14:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:18 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd Jul 09 05:14:18 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Flow 'volume_create_manager' (1a8a4699-86d5-424c-81e1-b29900c88c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b974a3-f1ec-41b2-a0e0-746be7ce3c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b974a3-f1ec-41b2-a0e0-746be7ce3c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1746243113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78a3dd6e1344289a98cede95645b8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:14:21Z,use_quota=True,user_id='7cff739395194aeab1b299c60d5e6f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d959101-c6b1-4d1f-a1c1-3b2ad670b765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d959101-c6b1-4d1f-a1c1-3b2ad670b765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126d894c-095f-44ac-8a4c-a52f95e6418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126d894c-095f-44ac-8a4c-a52f95e6418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a', 'volume_name': 'volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae9ff5f-2aa1-485d-b0d8-fcd7945cb190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae9ff5f-2aa1-485d-b0d8-fcd7945cb190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8422771-f091-4e8f-a062-41dbb97493a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:21 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Volume c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a', 'volume_size': 1} Jul 09 05:14:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:22 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" returned: 0 in 4.938s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:22 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c4bd58-c2e5-4bdf-8707-6e0c65f3d320]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:23 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 Jul 09 05:14:23 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:23 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" returned: 0 in 0.929s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:23 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1, size 1024.00 MB, duration 4.94 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:14:23 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Converted 1024.00 MB image at 207.33 MB/s Jul 09 05:14:23 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd is being set with open permissions: ugo+rw Jul 09 05:14:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:23 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd Jul 09 05:14:23 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:24 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" returned: 0 in 0.614s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" released by "_copy_volume_from_snapshot" :: held 8.304s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-a14fdbaf-4785-467d-a198-81ea160e00ce-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" released by "_create_volume_from_snapshot" :: held 8.350s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.366s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.086s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1746243113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78a3dd6e1344289a98cede95645b8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:14:21Z,use_quota=True,user_id='7cff739395194aeab1b299c60d5e6f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Creating volume c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:14:24 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:24 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a 1073741824 Jul 09 05:14:24 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5e6303-1162-4d3f-b245-8e345960c2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd', 'volume_size': 1, 'snapshot_id': 'a14fdbaf-4785-467d-a198-81ea160e00ce'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f8d9de-b4b7-4edd-9f61-6cf0c88ebb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:24 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Volume volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd (8b28fcbd-9543-40fd-9e2e-ac5c300f38dd): created successfully Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f8d9de-b4b7-4edd-9f61-6cf0c88ebb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Flow 'volume_create_manager' (12b4940e-d146-48b5-8440-81c9ead0b2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:24 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-eba8ceef-a755-4d46-8238-5430067b57bb tempest-VolumeDependencyTests-1238463760 None] Created volume successfully. Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "cinder-a14fdbaf-4785-467d-a198-81ea160e00ce-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-a14fdbaf-4785-467d-a198-81ea160e00ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "cinder-quobyte-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "cinder-quobyte-a14fdbaf-4785-467d-a198-81ea160e00ce" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-a14fdbaf-4785-467d-a198-81ea160e00ce" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Deleting offline snapshot a14fdbaf-4785-467d-a198-81ea160e00ce of volume f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] snapshot_file for this snap is: volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d2e84f-1f2d-4970-934e-9d6433f4eec0]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:24 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce Jul 09 05:14:24 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:25 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a 1073741824" returned: 0 in 0.846s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:25 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a Jul 09 05:14:25 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:25 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce" returned: 0 in 0.778s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:25 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:14:25 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6613ae2a-f928-439a-a1dd-060dd1d7fdf4]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:25 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 Jul 09 05:14:25 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:26 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a" returned: 0 in 0.660s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8422771-f091-4e8f-a062-41dbb97493a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19855beb-4588-4981-a92e-444c4d0116fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:26 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Volume volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a (c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a): created successfully Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19855beb-4588-4981-a92e-444c4d0116fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Flow 'volume_create_manager' (1a8a4699-86d5-424c-81e1-b29900c88c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:26 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d00b6cb9-d954-43e6-9a88-fc78258b9b5d tempest-VolumesCloneTest-638290688 None] Created volume successfully. Jul 09 05:14:26 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" returned: 0 in 0.787s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:26 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce Jul 09 05:14:26 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Flow 'volume_create_manager' (5c1b99fb-54c5-4ad4-a8b2-fdbdcba42216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f006f46e-cd7a-472e-af7c-828ccd874459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f006f46e-cd7a-472e-af7c-828ccd874459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-728580461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d8c907d-0622-4105-b09b-7ce5bc0aa609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78a3dd6e1344289a98cede95645b8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:14:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a,status='creating',terminated_at=None,updated_at=2026-07-09T03:14:27Z,use_quota=True,user_id='7cff739395194aeab1b299c60d5e6f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b8e2a4-def5-40c3-b6b5-7ae082ea7ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b8e2a4-def5-40c3-b6b5-7ae082ea7ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d884cb01-5d9c-4b77-b202-12d1f244090e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d884cb01-5d9c-4b77-b202-12d1f244090e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d8c907d-0622-4105-b09b-7ce5bc0aa609', 'volume_name': 'volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609', 'volume_size': 2, 'source_volid': 'c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a', 'source_volstatus': 'available'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c786bea8-9639-4490-bda9-767d86ba5c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c786bea8-9639-4490-bda9-767d86ba5c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b1784a-3590-4d4f-b9e1-d5577826df2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:26 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Volume 6d8c907d-0622-4105-b09b-7ce5bc0aa609: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609', 'volume_size': 2, 'source_volid': 'c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a', 'source_volstatus': 'available'} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:26 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Cloning volume c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a to volume 6d8c907d-0622-4105-b09b-7ce5bc0aa609 Jul 09 05:14:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Creating offline snapshot 41ab65dd-9e73-479f-9272-17b7e1a1a753 of volume c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:14:27 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02b0d95-253d-41cf-abfd-994813ce9d6d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:27 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a Jul 09 05:14:27 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:27 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce" returned: 0 in 0.758s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:27 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce Jul 09 05:14:27 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:27 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a" returned: 0 in 0.762s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:27 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 1G Jul 09 05:14:27 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:27 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1.a14fdbaf-4785-467d-a198-81ea160e00ce" returned: 0 in 0.655s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-a14fdbaf-4785-467d-a198-81ea160e00ce" released by "_delete_snapshot" :: held 3.083s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" released by "delete_snapshot" :: held 3.107s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:28 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Created reservations ['a353b8c9-a0b4-450a-a516-d84fbcec96fa', 'a17ae7cd-f4a6-4c1e-85ae-10a3e75a5bb3', 'a33acf34-9928-45bf-a0de-d45af9f7ee21', 'dba74fed-b129-49f5-a055-6fa076c766cc'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:14:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Delete snapshot completed successfully. Jul 09 05:14:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ee34ec09-1234-456a-a354-bffff8e19534 tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-a14fdbaf-4785-467d-a198-81ea160e00ce-delete_snapshot" released by "delete_snapshot" :: held 3.255s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:28 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 1G" returned: 0 in 0.799s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:28 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 Jul 09 05:14:28 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "cinder-f7316a09-90f3-483f-b0cf-a2c9d05b75a1-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-f7316a09-90f3-483f-b0cf-a2c9d05b75a1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "cinder-quobyte-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9d30e5-8424-47aa-affe-4a518ee5c9d6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:29 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753" returned: 0 in 0.701s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:29 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 is being set with open permissions: ugo+rw Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:29 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 Jul 09 05:14:29 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:29 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 Jul 09 05:14:29 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:29 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" returned: 0 in 0.746s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:29 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753" returned: 0 in 0.660s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:29 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1 Jul 09 05:14:29 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:29 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.info Jul 09 05:14:29 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:30 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" returned: 0 in 0.651s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-f7316a09-90f3-483f-b0cf-a2c9d05b75a1" released by "delete_volume" :: held 1.464s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:30 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.info" returned: 0 in 0.639s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:30 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.info is being set with open permissions: ugo+rw Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:30 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.info Jul 09 05:14:30 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Created reservations ['57d35349-55fd-47f4-a7ee-b50d7f87962c', '369b2419-b8e3-456c-94a0-d141b3b3464a', '2576367c-a463-4a44-a0c1-3d14b70d7185', '8091e456-c0a1-4fa8-ae10-6263ca72dc4e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:30 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:14:30 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:31 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.info" returned: 0 in 0.630s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Acquiring lock "cinder-quobyte-6d8c907d-0622-4105-b09b-7ce5bc0aa609" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Lock "cinder-quobyte-6d8c907d-0622-4105-b09b-7ce5bc0aa609" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] snapshot: 41ab65dd-9e73-479f-9272-17b7e1a1a753, volume: 6d8c907d-0622-4105-b09b-7ce5bc0aa609, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "cinder-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[adca3917-dec1-4401-a48d-433c5ff5aa33]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "cinder-quobyte-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:31 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.689s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:14:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Deleted volume successfully. Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[24515cca-47fc-49d0-98fd-9e190b56ac29]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:31 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 Jul 09 05:14:31 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-83303f2d-7ff4-4a92-a6df-561847677e77 tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-f7316a09-90f3-483f-b0cf-a2c9d05b75a1-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:31 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd Jul 09 05:14:31 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:32 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753" returned: 0 in 0.777s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d58edbf-5146-45b7-9b3f-82858d412bf3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:32 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" returned: 0 in 0.760s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:32 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd Jul 09 05:14:32 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:32 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a Jul 09 05:14:32 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:32 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" returned: 0 in 0.649s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-quobyte-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd" released by "delete_volume" :: held 1.462s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:32 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a" returned: 0 in 0.754s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:32 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 Jul 09 05:14:32 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Created reservations ['7937d1b7-8e1b-4d61-aaf6-dae3dfc5175d', '22ea8597-22b6-4188-af6b-db38015c1c45', '0237ad6a-74c7-4279-a453-46bca93c550a', '5e2786aa-6d57-4213-9f96-b05629923292'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:33 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:14:33 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:33 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.660s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:33 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:14:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Deleted volume successfully. Jul 09 05:14:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f669a03f-1656-4dfc-9d64-f959a00fa7dc tempest-VolumeDependencyTests-1238463760 None] Lock "cinder-8b28fcbd-9543-40fd-9e2e-ac5c300f38dd-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:37 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609" returned: 0 in 5.104s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:37 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3558731b-393d-4dde-908c-d0bf8e7bb643]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:38 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a Jul 09 05:14:38 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:38 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a" returned: 0 in 0.961s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:38 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:14:38 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Converted 1024.00 MB image at 200.57 MB/s Jul 09 05:14:38 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 is being set with open permissions: ugo+rw Jul 09 05:14:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:38 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 Jul 09 05:14:38 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:39 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:14:39 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:39 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609" returned: 0 in 0.692s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Lock "cinder-quobyte-6d8c907d-0622-4105-b09b-7ce5bc0aa609" released by "_copy_volume_from_snapshot" :: held 8.385s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Acquiring lock "cinder-quobyte-41ab65dd-9e73-479f-9272-17b7e1a1a753" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Lock "cinder-quobyte-41ab65dd-9e73-479f-9272-17b7e1a1a753" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Deleting offline snapshot 41ab65dd-9e73-479f-9272-17b7e1a1a753 of volume c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] snapshot_file for this snap is: volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc379c5-0208-43f2-9f5e-613b0d50d73e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:39 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.697s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:14:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:14:39 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 Jul 09 05:14:39 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:40 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753" returned: 0 in 0.815s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:14:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9099c493-7af8-4f45-890e-938d8d5364c8]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:40 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a Jul 09 05:14:40 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:41 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a" returned: 0 in 0.778s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:41 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 Jul 09 05:14:41 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:42 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753" returned: 0 in 0.746s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:42 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753 Jul 09 05:14:42 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:42 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a.41ab65dd-9e73-479f-9272-17b7e1a1a753" returned: 0 in 0.644s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Lock "cinder-quobyte-41ab65dd-9e73-479f-9272-17b7e1a1a753" released by "_delete_snapshot" :: held 3.083s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.865s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b1784a-3590-4d4f-b9e1-d5577826df2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609', 'volume_size': 2, 'source_volid': 'c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a', 'source_volstatus': 'available'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ed6c2f-b303-4f0f-afe0-051a33eec294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Volume volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 (6d8c907d-0622-4105-b09b-7ce5bc0aa609): created successfully Jul 09 05:14:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ed6c2f-b303-4f0f-afe0-051a33eec294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Flow 'volume_create_manager' (5c1b99fb-54c5-4ad4-a8b2-fdbdcba42216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:42 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a712bb82-fcc3-48e8-9c56-0d5ba662a9b2 tempest-VolumesCloneTest-638290688 None] Created volume successfully. Jul 09 05:14:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Acquiring lock "cinder-6d8c907d-0622-4105-b09b-7ce5bc0aa609-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Lock "cinder-6d8c907d-0622-4105-b09b-7ce5bc0aa609-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Acquiring lock "cinder-quobyte-6d8c907d-0622-4105-b09b-7ce5bc0aa609" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Lock "cinder-quobyte-6d8c907d-0622-4105-b09b-7ce5bc0aa609" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5906d529-5967-45b9-877d-0c99b32da3e5]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:43 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 Jul 09 05:14:43 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:44 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609" returned: 0 in 0.791s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:44 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609 Jul 09 05:14:44 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:44 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d8c907d-0622-4105-b09b-7ce5bc0aa609" returned: 0 in 0.648s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Lock "cinder-quobyte-6d8c907d-0622-4105-b09b-7ce5bc0aa609" released by "delete_volume" :: held 1.482s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Created reservations ['03210199-5320-46d3-b6b3-c4c05c6df466', '7667a503-9b6d-4154-905c-9b52c54d94d4', '35687a8c-9da8-4dd2-833a-5a2a5265496e', '7dfc1e6b-b667-4e5b-84f9-11e032b512fb'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:44 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:14:44 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Acquiring lock "cinder-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Lock "cinder-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:45 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.693s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:45 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:14:45 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Deleted volume successfully. Jul 09 05:14:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Acquiring lock "cinder-quobyte-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:14:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-38e5e429-30aa-4a09-9521-347f029185cd tempest-VolumesCloneTest-638290688 None] Lock "cinder-6d8c907d-0622-4105-b09b-7ce5bc0aa609-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Lock "cinder-quobyte-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a" acquired by "delete_volume" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:14:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3b5e1a-de8d-4410-843f-c6da2acb5b67]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:14:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:45 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a Jul 09 05:14:45 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:46 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a" returned: 0 in 0.835s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:46 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a Jul 09 05:14:46 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:47 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a" returned: 0 in 0.743s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Lock "cinder-quobyte-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a" released by "delete_volume" :: held 1.660s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:47 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Created reservations ['4ff2a8cc-c554-41cf-b425-783f5510796d', '77772d73-4af3-443e-af33-976899b0e6a6', '9282602e-3792-4c72-b873-208992d15655', '40a5d9da-d021-4d32-915f-18f2d2004608'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:14:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:47 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:14:47 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:48 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.714s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:48 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:14:48 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Deleted volume successfully. Jul 09 05:14:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-16a7b548-6348-43a2-a083-a19108a67978 tempest-VolumesCloneTest-638290688 None] Lock "cinder-c4e9356e-bb7f-4a24-afab-1fd2a21d5b4a-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=66,cinder:INSERT=14,cinder:SELECT=43,cinder:DELETE=4 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Flow 'volume_create_manager' (45107eaf-247d-4df3-87ee-0afe106051de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a600c27-96cf-4870-83e4-f7ccaac469ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a600c27-96cf-4870-83e4-f7ccaac469ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-119754129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3afe21-ea8a-4af4-a052-81a03b2654be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c270ab1b0c5449d6abab24b52a454834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:14:51Z,use_quota=True,user_id='c35af72bbf8f48b2acb6c23181a8e0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a70f601-fefb-4491-9bae-335473e6d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a70f601-fefb-4491-9bae-335473e6d49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde99f7f-119b-407c-8b3c-dd7754b2c14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde99f7f-119b-407c-8b3c-dd7754b2c14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3afe21-ea8a-4af4-a052-81a03b2654be', 'volume_name': 'volume-de3afe21-ea8a-4af4-a052-81a03b2654be', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7efd850-93c8-4ec1-8bc1-520da26ad798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7efd850-93c8-4ec1-8bc1-520da26ad798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36647849-e78d-47b2-83ee-edfb6bd3ee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:51 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Volume de3afe21-ea8a-4af4-a052-81a03b2654be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3afe21-ea8a-4af4-a052-81a03b2654be', 'volume_size': 1} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-119754129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3afe21-ea8a-4af4-a052-81a03b2654be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c270ab1b0c5449d6abab24b52a454834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:14:51Z,use_quota=True,user_id='c35af72bbf8f48b2acb6c23181a8e0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Creating volume de3afe21-ea8a-4af4-a052-81a03b2654be {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:14:51 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:51 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be 1073741824 Jul 09 05:14:51 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:51 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be 1073741824" returned: 0 in 0.863s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:52 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be Jul 09 05:14:52 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:52 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be" returned: 0 in 0.697s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:14:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36647849-e78d-47b2-83ee-edfb6bd3ee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3afe21-ea8a-4af4-a052-81a03b2654be', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48902bc-d362-42ea-8412-75af05ec381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:52 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Volume volume-de3afe21-ea8a-4af4-a052-81a03b2654be (de3afe21-ea8a-4af4-a052-81a03b2654be): created successfully Jul 09 05:14:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48902bc-d362-42ea-8412-75af05ec381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Flow 'volume_create_manager' (45107eaf-247d-4df3-87ee-0afe106051de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:52 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-593b98c1-91ec-4ff6-b2c0-f60b8d64c8cf tempest-VolumesListTestJSON-300540672 None] Created volume successfully. Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Flow 'volume_create_manager' (ca5f2762-0810-4bf8-8352-cafe2878a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d78b139-0a6e-4e3b-9346-49f256a27682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d78b139-0a6e-4e3b-9346-49f256a27682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-278641992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394c9a56-f52b-4f27-8fb9-e83408cdcaad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c270ab1b0c5449d6abab24b52a454834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:14:54Z,use_quota=True,user_id='c35af72bbf8f48b2acb6c23181a8e0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2102a72a-2588-4282-8dc2-c2af8bcf056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2102a72a-2588-4282-8dc2-c2af8bcf056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70ae983-ca9b-4fc3-af52-204302e6ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70ae983-ca9b-4fc3-af52-204302e6ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394c9a56-f52b-4f27-8fb9-e83408cdcaad', 'volume_name': 'volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853a8ca8-c985-49c0-865b-49d3858615b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853a8ca8-c985-49c0-865b-49d3858615b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc62330-cc78-4a63-b609-ceba20f86d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:53 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Volume 394c9a56-f52b-4f27-8fb9-e83408cdcaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad', 'volume_size': 1} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-278641992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394c9a56-f52b-4f27-8fb9-e83408cdcaad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c270ab1b0c5449d6abab24b52a454834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:14:54Z,use_quota=True,user_id='c35af72bbf8f48b2acb6c23181a8e0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Creating volume 394c9a56-f52b-4f27-8fb9-e83408cdcaad {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:14:53 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:14:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:53 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad 1073741824 Jul 09 05:14:53 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:54 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad 1073741824" returned: 0 in 0.870s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:54 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad Jul 09 05:14:54 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:55 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad" returned: 0 in 0.687s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:14:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc62330-cc78-4a63-b609-ceba20f86d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7e5b0a-9625-42df-9915-5304a26dae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:55 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Volume volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad (394c9a56-f52b-4f27-8fb9-e83408cdcaad): created successfully Jul 09 05:14:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7e5b0a-9625-42df-9915-5304a26dae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Flow 'volume_create_manager' (ca5f2762-0810-4bf8-8352-cafe2878a660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:55 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-efeda56c-6415-4728-8290-bcab69dd78f8 tempest-VolumesListTestJSON-300540672 None] Created volume successfully. Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Flow 'volume_create_manager' (c9e9e676-3f74-455b-ad31-9825a950e4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7846f5ba-ea29-4886-ba3b-930f01b3f6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7846f5ba-ea29-4886-ba3b-930f01b3f6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-502921600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7835cfca-59e6-4fb6-ab8d-54d414dba9cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c270ab1b0c5449d6abab24b52a454834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:14:56Z,use_quota=True,user_id='c35af72bbf8f48b2acb6c23181a8e0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f6a2bf-52dc-4c7b-8e99-4a355b1f0358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f6a2bf-52dc-4c7b-8e99-4a355b1f0358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d89b228-eedf-4716-bb50-c2f7f8c43104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d89b228-eedf-4716-bb50-c2f7f8c43104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7835cfca-59e6-4fb6-ab8d-54d414dba9cb', 'volume_name': 'volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88ca1be-e36b-4469-bc7b-fed0c3941e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88ca1be-e36b-4469-bc7b-fed0c3941e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e3047a-eda6-44a7-8dd2-e8e1a61b8a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Volume 7835cfca-59e6-4fb6-ab8d-54d414dba9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb', 'volume_size': 1} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-502921600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7835cfca-59e6-4fb6-ab8d-54d414dba9cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c270ab1b0c5449d6abab24b52a454834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:14:56Z,use_quota=True,user_id='c35af72bbf8f48b2acb6c23181a8e0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Creating volume 7835cfca-59e6-4fb6-ab8d-54d414dba9cb {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:14:56 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:14:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:56 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb 1073741824 Jul 09 05:14:56 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:57 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb 1073741824" returned: 0 in 0.829s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:14:57 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb Jul 09 05:14:57 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:14:57 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jul 09 05:14:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb" returned: 0 in 0.671s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:14:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:14:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:14:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e3047a-eda6-44a7-8dd2-e8e1a61b8a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f72f091-49bc-4c59-be05-430ab09dab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:14:58 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Volume volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb (7835cfca-59e6-4fb6-ab8d-54d414dba9cb): created successfully Jul 09 05:14:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f72f091-49bc-4c59-be05-430ab09dab08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:14:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Flow 'volume_create_manager' (c9e9e676-3f74-455b-ad31-9825a950e4e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:14:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-622c937d-2a5c-43f1-a71f-411e01ee6d2e tempest-VolumesListTestJSON-300540672 None] Created volume successfully. Jul 09 05:15:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Acquiring lock "cinder-7835cfca-59e6-4fb6-ab8d-54d414dba9cb-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Lock "cinder-7835cfca-59e6-4fb6-ab8d-54d414dba9cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Acquiring lock "cinder-quobyte-7835cfca-59e6-4fb6-ab8d-54d414dba9cb" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Lock "cinder-quobyte-7835cfca-59e6-4fb6-ab8d-54d414dba9cb" acquired by "delete_volume" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:00 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a3a7fd-ba81-477d-95c6-d05dad5f8ff7]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:01 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb Jul 09 05:15:01 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:01 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb" returned: 0 in 0.762s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:01 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb Jul 09 05:15:01 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:02 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7835cfca-59e6-4fb6-ab8d-54d414dba9cb" returned: 0 in 0.691s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Lock "cinder-quobyte-7835cfca-59e6-4fb6-ab8d-54d414dba9cb" released by "delete_volume" :: held 1.505s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:02 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Created reservations ['22de9b98-53a4-43c7-8235-af37ab78d7fd', '6d29a5b7-9e5b-41cc-8918-73a78e5a826a', '4ceb28f8-4731-4a3c-9a6c-cdfba4766e47', '460e391c-a6f0-43a3-b5cc-f4ae72b3a09a'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:15:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:02 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:15:02 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Acquiring lock "cinder-394c9a56-f52b-4f27-8fb9-e83408cdcaad-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Lock "cinder-394c9a56-f52b-4f27-8fb9-e83408cdcaad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Acquiring lock "cinder-quobyte-394c9a56-f52b-4f27-8fb9-e83408cdcaad" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Lock "cinder-quobyte-394c9a56-f52b-4f27-8fb9-e83408cdcaad" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:03 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.731s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:15:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Deleted volume successfully. Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[320a4aa8-5a5c-4e33-a93f-a90aa1654f72]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0133ce3-5126-402e-ac0d-5da5bf1858da tempest-VolumesListTestJSON-300540672 None] Lock "cinder-7835cfca-59e6-4fb6-ab8d-54d414dba9cb-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:03 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad Jul 09 05:15:03 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Flow 'volume_create_manager' (e0c89d24-8739-4624-9c68-d6d10e28ef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3f6211-b9b7-4997-be42-79ec2347c128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3f6211-b9b7-4997-be42-79ec2347c128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1432934625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfb7a69-9cd8-4523-9a67-16694867ae94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2cd241a4e54c779c95f745dd7257e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:15:04Z,use_quota=True,user_id='0ceb22f70062446eb0ee2a01a3c9dd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c7fe8d-988b-4279-8993-55931f657484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c7fe8d-988b-4279-8993-55931f657484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149b1acf-bfc9-42a7-a399-eed2dda0f270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149b1acf-bfc9-42a7-a399-eed2dda0f270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfb7a69-9cd8-4523-9a67-16694867ae94', 'volume_name': 'volume-cdfb7a69-9cd8-4523-9a67-16694867ae94', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b667d77d-0feb-4dbb-b15f-d26365bc7d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b667d77d-0feb-4dbb-b15f-d26365bc7d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0fb10a-7e73-4cec-9392-99fb0456e5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:03 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Volume cdfb7a69-9cd8-4523-9a67-16694867ae94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfb7a69-9cd8-4523-9a67-16694867ae94', 'volume_size': 1} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1432934625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfb7a69-9cd8-4523-9a67-16694867ae94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2cd241a4e54c779c95f745dd7257e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:15:04Z,use_quota=True,user_id='0ceb22f70062446eb0ee2a01a3c9dd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Creating volume cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:15:03 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:15:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:03 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 1073741824 Jul 09 05:15:03 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:04 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad" returned: 0 in 0.817s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:04 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad Jul 09 05:15:04 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:04 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 1073741824" returned: 0 in 0.852s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:04 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 Jul 09 05:15:04 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:04 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-394c9a56-f52b-4f27-8fb9-e83408cdcaad" returned: 0 in 0.689s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Lock "cinder-quobyte-394c9a56-f52b-4f27-8fb9-e83408cdcaad" released by "delete_volume" :: held 1.561s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Created reservations ['9bcc8c11-f08b-4492-8b37-ac4b4c7bd5da', '5ccb01c2-a170-4f74-a4f8-23a1aba889a9', '04fe27b8-dd68-4f1c-8d1f-8ced197c6430', 'a06a7a92-b25c-4162-8497-08ee96581943'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:04 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:15:04 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:05 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94" returned: 0 in 0.637s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0fb10a-7e73-4cec-9392-99fb0456e5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfb7a69-9cd8-4523-9a67-16694867ae94', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f669f1-0ca6-4499-98f8-a4b33da8a520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:05 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Volume volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 (cdfb7a69-9cd8-4523-9a67-16694867ae94): created successfully Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f669f1-0ca6-4499-98f8-a4b33da8a520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Flow 'volume_create_manager' (e0c89d24-8739-4624-9c68-d6d10e28ef49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:15:05 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d88068aa-330a-4525-b98c-5e3b032acc8f tempest-SnapshotDependencyTests-1025773506 None] Created volume successfully. Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Acquiring lock "cinder-de3afe21-ea8a-4af4-a052-81a03b2654be-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Lock "cinder-de3afe21-ea8a-4af4-a052-81a03b2654be-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Acquiring lock "cinder-quobyte-de3afe21-ea8a-4af4-a052-81a03b2654be" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Lock "cinder-quobyte-de3afe21-ea8a-4af4-a052-81a03b2654be" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:05 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.663s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:15:05 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Deleted volume successfully. Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9026bda8-1813-4759-ac11-f1bca5164455]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-035b9bae-3ff3-43e5-9399-98cb195aeb0e tempest-VolumesListTestJSON-300540672 None] Lock "cinder-394c9a56-f52b-4f27-8fb9-e83408cdcaad-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:05 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be Jul 09 05:15:05 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Creating offline snapshot 31e66ae5-24ad-4c84-9358-84f31af8b7d7 of volume cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:15:06 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad39159b-8b70-45fc-9bda-560d215b562f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:06 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 Jul 09 05:15:06 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:06 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be" returned: 0 in 0.784s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:06 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be Jul 09 05:15:06 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:06 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94" returned: 0 in 0.776s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:06 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 1G Jul 09 05:15:06 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:07 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-de3afe21-ea8a-4af4-a052-81a03b2654be" returned: 0 in 0.683s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Lock "cinder-quobyte-de3afe21-ea8a-4af4-a052-81a03b2654be" released by "delete_volume" :: held 1.513s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Created reservations ['b4247a7e-eb3f-46f3-b9e0-2216eada1c0c', '4b8e255e-c178-4045-9431-6332079ad213', '02b19c62-56f0-4f74-85db-370834c21ad1', '4205deea-c3bd-4069-aa7a-d125b7f99f25'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:07 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:15:07 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:07 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 1G" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:07 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 Jul 09 05:15:07 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:07 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.654s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:15:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Deleted volume successfully. Jul 09 05:15:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-268c46dd-e223-4e71-8645-885e57984438 tempest-VolumesListTestJSON-300540672 None] Lock "cinder-de3afe21-ea8a-4af4-a052-81a03b2654be-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:08 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7" returned: 0 in 0.743s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:08 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 is being set with open permissions: ugo+rw Jul 09 05:15:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:08 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 Jul 09 05:15:08 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:09 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7" returned: 0 in 0.679s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:09 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.info Jul 09 05:15:09 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:09 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.info" returned: 0 in 0.700s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:09 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.info is being set with open permissions: ugo+rw Jul 09 05:15:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:09 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.info Jul 09 05:15:09 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:10 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.info" returned: 0 in 0.661s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.451s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:10 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=77,cinder:UPDATE=87,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:15:10 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-befa376f-619a-4c81-97df-70f2bb042704 tempest-SnapshotDependencyTests-1025773506 None] Create snapshot completed successfully Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Flow 'volume_create_manager' (cd0d3788-024e-4c95-a4b9-84da23cdc567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35678fe-7ff0-4f10-9caa-64198a42d6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35678fe-7ff0-4f10-9caa-64198a42d6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b10083e-5457-4d56-bb83-b68c46e1c54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2cd241a4e54c779c95f745dd7257e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=31e66ae5-24ad-4c84-9358-84f31af8b7d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:15:12Z,use_quota=True,user_id='0ceb22f70062446eb0ee2a01a3c9dd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd49a44-0aab-4a28-9f9a-f7402b9c9367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd49a44-0aab-4a28-9f9a-f7402b9c9367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac738a95-18ca-44aa-a6e1-ad89a73c73cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac738a95-18ca-44aa-a6e1-ad89a73c73cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b10083e-5457-4d56-bb83-b68c46e1c54c', 'volume_name': 'volume-4b10083e-5457-4d56-bb83-b68c46e1c54c', 'volume_size': 1, 'snapshot_id': '31e66ae5-24ad-4c84-9358-84f31af8b7d7'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e347a471-dbe8-448c-94e4-6dff84836829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e347a471-dbe8-448c-94e4-6dff84836829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36961fd8-cbc3-4c14-903f-9b1881fddf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Volume 4b10083e-5457-4d56-bb83-b68c46e1c54c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b10083e-5457-4d56-bb83-b68c46e1c54c', 'volume_size': 1, 'snapshot_id': '31e66ae5-24ad-4c84-9358-84f31af8b7d7'} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "cinder-quobyte-31e66ae5-24ad-4c84-9358-84f31af8b7d7-4b10083e-5457-4d56-bb83-b68c46e1c54c" by "_create_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-31e66ae5-24ad-4c84-9358-84f31af8b7d7-4b10083e-5457-4d56-bb83-b68c46e1c54c" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Creating volume 4b10083e-5457-4d56-bb83-b68c46e1c54c from snapshot 31e66ae5-24ad-4c84-9358-84f31af8b7d7 {{(pid=87161) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "cinder-quobyte-4b10083e-5457-4d56-bb83-b68c46e1c54c" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-4b10083e-5457-4d56-bb83-b68c46e1c54c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] snapshot: 31e66ae5-24ad-4c84-9358-84f31af8b7d7, volume: 4b10083e-5457-4d56-bb83-b68c46e1c54c, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dae00a-ab77-4f40-8f00-4dfa506ba22c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:12 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 Jul 09 05:15:12 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:12 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7" returned: 0 in 0.786s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfb7a69-9cd8-4523-9a67-16694867ae94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9c89fd-e434-4595-bc97-25d9d0f16223]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:12 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 Jul 09 05:15:12 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:13 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:13 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:15:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:13 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c Jul 09 05:15:13 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:19 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c" returned: 0 in 5.890s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:19 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[552709ca-a418-45b7-85d4-c1da32cb8511]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:19 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 Jul 09 05:15:19 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:20 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94" returned: 0 in 0.982s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:20 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:15:20 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Converted 1024.00 MB image at 173.82 MB/s Jul 09 05:15:20 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c is being set with open permissions: ugo+rw Jul 09 05:15:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:20 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c Jul 09 05:15:20 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:21 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c" returned: 0 in 0.719s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-4b10083e-5457-4d56-bb83-b68c46e1c54c" released by "_copy_volume_from_snapshot" :: held 9.286s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-31e66ae5-24ad-4c84-9358-84f31af8b7d7-4b10083e-5457-4d56-bb83-b68c46e1c54c" released by "_create_volume_from_snapshot" :: held 9.318s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.335s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36961fd8-cbc3-4c14-903f-9b1881fddf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b10083e-5457-4d56-bb83-b68c46e1c54c', 'volume_size': 1, 'snapshot_id': '31e66ae5-24ad-4c84-9358-84f31af8b7d7'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10119d65-68e4-4260-94a0-87087db88872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:21 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Volume volume-4b10083e-5457-4d56-bb83-b68c46e1c54c (4b10083e-5457-4d56-bb83-b68c46e1c54c): created successfully Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10119d65-68e4-4260-94a0-87087db88872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Flow 'volume_create_manager' (cd0d3788-024e-4c95-a4b9-84da23cdc567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:15:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-832e5627-b436-4c52-805e-e79567f340a9 tempest-SnapshotDependencyTests-1025773506 None] Created volume successfully. Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "cinder-31e66ae5-24ad-4c84-9358-84f31af8b7d7-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-31e66ae5-24ad-4c84-9358-84f31af8b7d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "cinder-quobyte-cdfb7a69-9cd8-4523-9a67-16694867ae94" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-cdfb7a69-9cd8-4523-9a67-16694867ae94" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "cinder-quobyte-31e66ae5-24ad-4c84-9358-84f31af8b7d7" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-31e66ae5-24ad-4c84-9358-84f31af8b7d7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Deleting offline snapshot 31e66ae5-24ad-4c84-9358-84f31af8b7d7 of volume cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] snapshot_file for this snap is: volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2841cb28-7a2a-4a1a-8683-fbaa53689c14]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:22 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 Jul 09 05:15:22 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Flow 'volume_create_manager' (0bfd5cb7-58c3-4348-86fe-34df9d92c6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4431d2a2-8d7d-4f3e-b368-022b5889304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4431d2a2-8d7d-4f3e-b368-022b5889304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-42666613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d01d55f-6ed6-4b00-9b48-e6b6724a233b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23191ef9e5854a439c5c706fb03062e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:15:22Z,use_quota=True,user_id='e561302437a94a1ea00aa48f06cb0815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42574bd3-b41a-4ac5-b367-6af1f709fdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42574bd3-b41a-4ac5-b367-6af1f709fdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2684098b-e08b-456c-b588-c534ff82a30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2684098b-e08b-456c-b588-c534ff82a30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d01d55f-6ed6-4b00-9b48-e6b6724a233b', 'volume_name': 'volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d5bb70-da81-4f96-adb6-a26222e5f2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d5bb70-da81-4f96-adb6-a26222e5f2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c7a1ec-dee4-4eee-a7cd-fde19e14e36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:22 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Volume 6d01d55f-6ed6-4b00-9b48-e6b6724a233b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b', 'volume_size': 1} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-42666613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d01d55f-6ed6-4b00-9b48-e6b6724a233b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23191ef9e5854a439c5c706fb03062e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:15:22Z,use_quota=True,user_id='e561302437a94a1ea00aa48f06cb0815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Creating volume 6d01d55f-6ed6-4b00-9b48-e6b6724a233b {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:15:22 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:22 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b 1073741824 Jul 09 05:15:22 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:22 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7" returned: 0 in 0.789s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfb7a69-9cd8-4523-9a67-16694867ae94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a9bffc-069c-43c8-b2e5-a3077cefcfba]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:22 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 Jul 09 05:15:22 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:23 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b 1073741824" returned: 0 in 0.845s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:23 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b Jul 09 05:15:23 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:23 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94" returned: 0 in 0.796s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:23 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 Jul 09 05:15:23 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:23 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" returned: 0 in 0.693s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c7a1ec-dee4-4eee-a7cd-fde19e14e36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17912b1a-2d16-4c18-9cae-1f9344f0b40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:23 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Volume volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b (6d01d55f-6ed6-4b00-9b48-e6b6724a233b): created successfully Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17912b1a-2d16-4c18-9cae-1f9344f0b40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:23 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Flow 'volume_create_manager' (0bfd5cb7-58c3-4348-86fe-34df9d92c6f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:15:24 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d61d9d56-4b59-4f77-a994-2f1f140912db tempest-VolumesSnapshotTestJSON-2028010313 None] Created volume successfully. Jul 09 05:15:24 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7" returned: 0 in 0.776s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:24 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7 Jul 09 05:15:24 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Creating offline snapshot 131e5313-1e7e-4d74-883a-c65af190bdbd of volume 6d01d55f-6ed6-4b00-9b48-e6b6724a233b {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:15:24 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0196cf40-dd2e-4821-9489-5c3388df883b]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:24 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b Jul 09 05:15:24 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:25 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94.31e66ae5-24ad-4c84-9358-84f31af8b7d7" returned: 0 in 0.702s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-31e66ae5-24ad-4c84-9358-84f31af8b7d7" released by "_delete_snapshot" :: held 3.168s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-cdfb7a69-9cd8-4523-9a67-16694867ae94" released by "delete_snapshot" :: held 3.191s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:25 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Created reservations ['0c2d1661-1cf6-4894-a545-bef666773894', '357b921d-fa71-4d50-af0e-2636e3dfc170', '8180b292-ea71-46f6-ab8f-e82190ffb16c', '3d973f43-85bc-40b4-871e-8f1d9d9a71e3'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:15:25 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Delete snapshot completed successfully. Jul 09 05:15:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b6fa662-3f4a-4191-a590-6a22af8d0b02 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-31e66ae5-24ad-4c84-9358-84f31af8b7d7-delete_snapshot" released by "delete_snapshot" :: held 3.327s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:25 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" returned: 0 in 0.764s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:25 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd 1G Jul 09 05:15:25 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "cinder-cdfb7a69-9cd8-4523-9a67-16694867ae94-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-cdfb7a69-9cd8-4523-9a67-16694867ae94-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "cinder-quobyte-cdfb7a69-9cd8-4523-9a67-16694867ae94" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-cdfb7a69-9cd8-4523-9a67-16694867ae94" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:26 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1833d5d3-48d0-4305-aa65-7165ca152879]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:26 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 Jul 09 05:15:26 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:26 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd 1G" returned: 0 in 0.857s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:26 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd Jul 09 05:15:26 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:27 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94" returned: 0 in 0.792s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:27 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94 Jul 09 05:15:27 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:27 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd" returned: 0 in 0.707s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:27 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd is being set with open permissions: ugo+rw Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:27 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd Jul 09 05:15:27 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:27 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cdfb7a69-9cd8-4523-9a67-16694867ae94" returned: 0 in 0.645s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-cdfb7a69-9cd8-4523-9a67-16694867ae94" released by "delete_volume" :: held 1.495s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Created reservations ['84bf261e-d81f-4e61-b3b8-89d44f05baf0', '54a6b25c-7278-47ab-854e-c4e62f849c75', 'd47cb346-7d78-47b2-bc49-e5d23ad3bfba', '4919d2dc-6fad-4cfc-9be2-22b27b1c71dc'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:27 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:15:27 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:27 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd" returned: 0 in 0.666s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:27 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.info Jul 09 05:15:27 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "cinder-4b10083e-5457-4d56-bb83-b68c46e1c54c-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-4b10083e-5457-4d56-bb83-b68c46e1c54c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "cinder-quobyte-4b10083e-5457-4d56-bb83-b68c46e1c54c" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-4b10083e-5457-4d56-bb83-b68c46e1c54c" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[753ff888-5118-4c5c-864f-77db1979ef6a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:28 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.699s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:15:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Deleted volume successfully. Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f331f31d-6d95-4489-a237-96666b40e142 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-cdfb7a69-9cd8-4523-9a67-16694867ae94-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:28 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c Jul 09 05:15:28 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:28 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.info" returned: 0 in 0.720s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:28 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.info is being set with open permissions: ugo+rw Jul 09 05:15:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:28 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.info Jul 09 05:15:28 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:29 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:29 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.info" returned: 0 in 0.638s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c" returned: 0 in 0.805s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:29 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c Jul 09 05:15:29 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d1295b23-a040-4e35-b0c8-5d66d3105f76 tempest-VolumesSnapshotTestJSON-2028010313 None] Create snapshot completed successfully Jul 09 05:15:29 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-4b10083e-5457-4d56-bb83-b68c46e1c54c" returned: 0 in 0.639s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-quobyte-4b10083e-5457-4d56-bb83-b68c46e1c54c" released by "delete_volume" :: held 1.492s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:29 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Created reservations ['e28aea1f-74ff-454b-8d55-a89731e24178', '5666523f-348a-430e-98fc-dfd95e16334b', 'aa17f55f-ec92-4a26-8987-087d037e8389', '917c0791-e9ee-478a-bb83-3d7536ddead3'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-131e5313-1e7e-4d74-883a-c65af190bdbd-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-131e5313-1e7e-4d74-883a-c65af190bdbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:30 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:15:30 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-131e5313-1e7e-4d74-883a-c65af190bdbd" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-131e5313-1e7e-4d74-883a-c65af190bdbd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Deleting offline snapshot 131e5313-1e7e-4d74-883a-c65af190bdbd of volume 6d01d55f-6ed6-4b00-9b48-e6b6724a233b {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] snapshot_file for this snap is: volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[03887efd-523f-40eb-b5cd-edd6a9a40f9c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:30 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd Jul 09 05:15:30 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:30 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.685s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:15:30 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Deleted volume successfully. Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29ced914-b7e4-477c-a3a3-9375d29f7842 tempest-SnapshotDependencyTests-1025773506 None] Lock "cinder-4b10083e-5457-4d56-bb83-b68c46e1c54c-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:30 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd" returned: 0 in 0.794s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[072da0f9-4674-4a83-b38d-f2c7253ca8a3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:31 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b Jul 09 05:15:31 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:31 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" returned: 0 in 0.804s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:31 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd Jul 09 05:15:31 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:32 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd" returned: 0 in 0.764s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:32 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd Jul 09 05:15:32 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:33 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b.131e5313-1e7e-4d74-883a-c65af190bdbd" returned: 0 in 0.651s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-131e5313-1e7e-4d74-883a-c65af190bdbd" released by "_delete_snapshot" :: held 3.144s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" released by "delete_snapshot" :: held 3.170s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:33 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Created reservations ['bf601e90-49ae-490c-84b9-3bdebc00b14e', 'd2335a96-7213-44fc-a17d-58355f7e143e', '453f53cd-c4a5-4207-9d7a-f914a5a78c85', '94323796-f7dd-46de-a23f-6df9c7a339b5'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:15:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Delete snapshot completed successfully. Jul 09 05:15:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-53e7cd60-d528-4560-ae32-7c129f910d62 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-131e5313-1e7e-4d74-883a-c65af190bdbd-delete_snapshot" released by "delete_snapshot" :: held 3.373s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Flow 'volume_create_manager' (6aef8dc5-c194-436c-a750-fa7ee01762ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98da0a0f-2ff1-4899-b064-6db6526564a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98da0a0f-2ff1-4899-b064-6db6526564a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-825643341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad87ede-01af-49c5-9dd1-af01d2dfded0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23191ef9e5854a439c5c706fb03062e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:15:35Z,use_quota=True,user_id='e561302437a94a1ea00aa48f06cb0815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400902be-256c-4a04-b43c-549d64f08c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400902be-256c-4a04-b43c-549d64f08c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1552420d-50c7-4026-aec3-4a84fa994c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1552420d-50c7-4026-aec3-4a84fa994c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ad87ede-01af-49c5-9dd1-af01d2dfded0', 'volume_name': 'volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef19a18a-6c29-4ae0-b88f-c0d634b16fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef19a18a-6c29-4ae0-b88f-c0d634b16fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12196ea3-47bf-4021-a476-d9ee29f23755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Volume 1ad87ede-01af-49c5-9dd1-af01d2dfded0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0', 'volume_size': 1} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-825643341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad87ede-01af-49c5-9dd1-af01d2dfded0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23191ef9e5854a439c5c706fb03062e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:15:35Z,use_quota=True,user_id='e561302437a94a1ea00aa48f06cb0815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Creating volume 1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:15:34 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:15:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:34 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 1073741824 Jul 09 05:15:34 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:35 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 1073741824" returned: 0 in 0.806s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:35 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 Jul 09 05:15:35 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:36 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0" returned: 0 in 0.693s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:15:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12196ea3-47bf-4021-a476-d9ee29f23755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38da563f-6b72-44a9-a419-f7dc4b919de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:36 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Volume volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 (1ad87ede-01af-49c5-9dd1-af01d2dfded0): created successfully Jul 09 05:15:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38da563f-6b72-44a9-a419-f7dc4b919de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Flow 'volume_create_manager' (6aef8dc5-c194-436c-a750-fa7ee01762ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:15:36 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-42b64a81-6bae-4464-bf27-659b69153b87 tempest-VolumesSnapshotTestJSON-2028010313 None] Created volume successfully. Jul 09 05:15:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Creating offline snapshot 92125ceb-6249-4554-b79e-2d51916d98e4 of volume 1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:15:37 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[832cce86-cceb-43db-bbcd-b201f60957d5]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:37 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 Jul 09 05:15:37 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:37 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0" returned: 0 in 0.779s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:37 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 1G Jul 09 05:15:37 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:38 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 1G" returned: 0 in 0.881s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:38 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 Jul 09 05:15:38 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:39 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:15:39 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:39 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4" returned: 0 in 0.740s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:39 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 is being set with open permissions: ugo+rw Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:39 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 Jul 09 05:15:39 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:39 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.725s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:15:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:15:40 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4" returned: 0 in 0.711s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:40 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.info Jul 09 05:15:40 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:40 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.info" returned: 0 in 0.643s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:40 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.info is being set with open permissions: ugo+rw Jul 09 05:15:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:40 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.info Jul 09 05:15:40 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:41 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.info" returned: 0 in 0.663s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.514s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:41 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-65b0cf96-8fa2-4d77-930c-12696f3b1349 tempest-VolumesSnapshotTestJSON-2028010313 None] Create snapshot completed successfully Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Flow 'volume_create_manager' (aa58438f-02b5-44a5-b1fa-fbf8244f23b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0812ba-6fdd-4254-b947-b07fe15f3c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0812ba-6fdd-4254-b947-b07fe15f3c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-296113178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1df65e-7038-417f-b37e-7e2fa8b7cad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23191ef9e5854a439c5c706fb03062e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:15:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=92125ceb-6249-4554-b79e-2d51916d98e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:15:43Z,use_quota=True,user_id='e561302437a94a1ea00aa48f06cb0815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557b2a51-2eac-471c-abad-64daf661a81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557b2a51-2eac-471c-abad-64daf661a81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9237368-c207-427e-91ec-b5bbe85cc409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9237368-c207-427e-91ec-b5bbe85cc409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c1df65e-7038-417f-b37e-7e2fa8b7cad9', 'volume_name': 'volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9', 'volume_size': 2, 'snapshot_id': '92125ceb-6249-4554-b79e-2d51916d98e4'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08fa034-338b-4b65-9230-4cd0c613556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08fa034-338b-4b65-9230-4cd0c613556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee0fddd-52c7-4777-8edb-b880e822fdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Volume 8c1df65e-7038-417f-b37e-7e2fa8b7cad9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9', 'volume_size': 2, 'snapshot_id': '92125ceb-6249-4554-b79e-2d51916d98e4'} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-92125ceb-6249-4554-b79e-2d51916d98e4-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" by "_create_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-92125ceb-6249-4554-b79e-2d51916d98e4-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Creating volume 8c1df65e-7038-417f-b37e-7e2fa8b7cad9 from snapshot 92125ceb-6249-4554-b79e-2d51916d98e4 {{(pid=87161) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] snapshot: 92125ceb-6249-4554-b79e-2d51916d98e4, volume: 8c1df65e-7038-417f-b37e-7e2fa8b7cad9, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4824e4de-fb5c-46a1-ac71-1439d281a887]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:43 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 Jul 09 05:15:43 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:43 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4" returned: 0 in 0.760s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:15:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:15:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:15:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d748c1ee-09f3-4758-804e-8fe9a77565a6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:43 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 Jul 09 05:15:43 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:44 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0" returned: 0 in 0.750s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:44 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:15:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:44 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 Jul 09 05:15:44 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:49 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" returned: 0 in 4.490s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:49 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8f7bc7-ba6b-4be1-8372-7f99d0bfbb9a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:49 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 Jul 09 05:15:49 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:49 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0" returned: 0 in 0.967s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:49 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0, size 1024.00 MB, duration 4.49 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:15:49 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Converted 1024.00 MB image at 227.98 MB/s Jul 09 05:15:49 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 is being set with open permissions: ugo+rw Jul 09 05:15:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:50 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 Jul 09 05:15:50 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:50 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" returned: 0 in 0.662s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" released by "_copy_volume_from_snapshot" :: held 7.716s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-92125ceb-6249-4554-b79e-2d51916d98e4-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" released by "_create_volume_from_snapshot" :: held 7.743s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.757s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee0fddd-52c7-4777-8edb-b880e822fdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9', 'volume_size': 2, 'snapshot_id': '92125ceb-6249-4554-b79e-2d51916d98e4'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3957cd01-4d31-4da0-aa0b-4cf2ff127368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:15:50 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Volume volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 (8c1df65e-7038-417f-b37e-7e2fa8b7cad9): created successfully Jul 09 05:15:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3957cd01-4d31-4da0-aa0b-4cf2ff127368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:15:50 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Flow 'volume_create_manager' (aa58438f-02b5-44a5-b1fa-fbf8244f23b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:15:50 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ccf6e695-501d-4eeb-b890-dd7438b345ad tempest-VolumesSnapshotTestJSON-2028010313 None] Created volume successfully. Jul 09 05:15:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-8c1df65e-7038-417f-b37e-7e2fa8b7cad9-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-8c1df65e-7038-417f-b37e-7e2fa8b7cad9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:51 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=61,cinder:UPDATE=77,cinder:INSERT=21,cinder:DELETE=11 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:15:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:52 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9716d1a1-32ab-4c05-974e-534e33c430d3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:52 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 Jul 09 05:15:52 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:52 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" returned: 0 in 0.784s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:52 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9 Jul 09 05:15:52 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:53 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" returned: 0 in 0.672s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-8c1df65e-7038-417f-b37e-7e2fa8b7cad9" released by "delete_volume" :: held 1.496s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:53 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Created reservations ['0354d79d-ba39-4253-a2a8-f943d9b736af', '4cf21d29-c9d4-41c0-99a2-c2ea1d307a23', '674c595f-900f-44aa-9d25-7a295c6abb7e', 'e84ac619-ef3a-4244-a927-e8e175f6d592'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:15:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:15:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:15:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:15:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:15:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:15:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:53 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:15:53 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-92125ceb-6249-4554-b79e-2d51916d98e4-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-92125ceb-6249-4554-b79e-2d51916d98e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-1ad87ede-01af-49c5-9dd1-af01d2dfded0" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:54 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.642s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-1ad87ede-01af-49c5-9dd1-af01d2dfded0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-92125ceb-6249-4554-b79e-2d51916d98e4" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Deleted volume successfully. Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-92125ceb-6249-4554-b79e-2d51916d98e4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Deleting offline snapshot 92125ceb-6249-4554-b79e-2d51916d98e4 of volume 1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] snapshot_file for this snap is: volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-998b2be3-134c-44c8-bb7c-e495548611ff tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-8c1df65e-7038-417f-b37e-7e2fa8b7cad9-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f39b4f8-e480-4a09-9c4b-97735f219f9a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:54 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 Jul 09 05:15:54 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:55 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4" returned: 0 in 0.797s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:15:55 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b2d00e-b084-4b4e-8595-f52b4ca7d22e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:55 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 Jul 09 05:15:55 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:55 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0" returned: 0 in 0.776s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:55 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 Jul 09 05:15:55 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:56 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4" returned: 0 in 0.714s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:56 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4 Jul 09 05:15:56 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:57 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0.92125ceb-6249-4554-b79e-2d51916d98e4" returned: 0 in 0.623s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-92125ceb-6249-4554-b79e-2d51916d98e4" released by "_delete_snapshot" :: held 3.005s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-1ad87ede-01af-49c5-9dd1-af01d2dfded0" released by "delete_snapshot" :: held 3.033s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:57 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Created reservations ['631ed43a-d60b-4f22-9a41-f978f08be2a1', '9eb5896d-2f9b-4456-a8e4-c536ea06c1bf', '5d73f093-34a8-4356-8eb2-e23451320e46', '93fc99bc-56a7-4dd4-8efe-6f4863601f1e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:15:57 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Delete snapshot completed successfully. Jul 09 05:15:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8954345d-4857-4b2b-9b5c-dad963624b1c tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-92125ceb-6249-4554-b79e-2d51916d98e4-delete_snapshot" released by "delete_snapshot" :: held 3.182s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:15:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-1ad87ede-01af-49c5-9dd1-af01d2dfded0-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-1ad87ede-01af-49c5-9dd1-af01d2dfded0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-1ad87ede-01af-49c5-9dd1-af01d2dfded0" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:15:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-1ad87ede-01af-49c5-9dd1-af01d2dfded0" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:15:58 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8308ef7e-88d1-493b-b68a-e5dfbe6fba1c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:15:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:58 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 Jul 09 05:15:58 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:15:59 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Jul 09 05:15:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0" returned: 0 in 0.825s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:15:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:15:59 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0 Jul 09 05:15:59 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:00 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1ad87ede-01af-49c5-9dd1-af01d2dfded0" returned: 0 in 0.665s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-1ad87ede-01af-49c5-9dd1-af01d2dfded0" released by "delete_volume" :: held 1.549s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Created reservations ['5374ac33-b6e1-4b4a-a0b0-73b9403af218', '8a8935a1-da16-42af-af42-ca57492fa150', '5648c847-e956-4dbb-b3c9-d59c4c319b00', 'd6e53b60-a883-4abc-a6e2-95f6cf5bee87'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:00 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:16:00 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:00 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.666s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:16:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Deleted volume successfully. Jul 09 05:16:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0548db3b-2b97-418f-a375-dd1ba1563155 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-1ad87ede-01af-49c5-9dd1-af01d2dfded0-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Flow 'volume_create_manager' (d9c11c3e-4a99-413b-b29a-14ddf5fca939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02073bd-1076-4cca-b58c-379576b61640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02073bd-1076-4cca-b58c-379576b61640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-882526771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb141e9-129e-44ba-93ed-ecdc9550ab89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23191ef9e5854a439c5c706fb03062e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:16:01Z,use_quota=True,user_id='e561302437a94a1ea00aa48f06cb0815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd11beb-6f82-4989-9eab-51535b693e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd11beb-6f82-4989-9eab-51535b693e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fd921d-0aa2-47ae-bdf2-1f30a5937505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fd921d-0aa2-47ae-bdf2-1f30a5937505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb141e9-129e-44ba-93ed-ecdc9550ab89', 'volume_name': 'volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f20d89-8782-4a9a-9c67-69d6a6ec2b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f20d89-8782-4a9a-9c67-69d6a6ec2b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639e38fa-cbd5-4e7b-a9b1-0ec7d26c36ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:01 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Volume 5bb141e9-129e-44ba-93ed-ecdc9550ab89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89', 'volume_size': 1} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-882526771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb141e9-129e-44ba-93ed-ecdc9550ab89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23191ef9e5854a439c5c706fb03062e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:16:01Z,use_quota=True,user_id='e561302437a94a1ea00aa48f06cb0815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Creating volume 5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:16:01 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:16:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:01 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 1073741824 Jul 09 05:16:01 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:02 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 1073741824" returned: 0 in 0.869s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:02 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 Jul 09 05:16:02 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:02 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89" returned: 0 in 0.646s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:16:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639e38fa-cbd5-4e7b-a9b1-0ec7d26c36ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fb4a77-30c5-4fed-869f-97c1de984414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:02 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Volume volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 (5bb141e9-129e-44ba-93ed-ecdc9550ab89): created successfully Jul 09 05:16:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fb4a77-30c5-4fed-869f-97c1de984414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Flow 'volume_create_manager' (d9c11c3e-4a99-413b-b29a-14ddf5fca939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:16:02 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-db7cea1b-be94-4865-8c26-9d08f0b2eb81 tempest-VolumesSnapshotTestJSON-2028010313 None] Created volume successfully. Jul 09 05:16:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Creating offline snapshot 2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 of volume 5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:16:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[29289c08-294d-4cf0-bc1c-e76080c567a3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:16:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:03 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 Jul 09 05:16:03 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:04 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89" returned: 0 in 0.757s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:04 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 1G Jul 09 05:16:04 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:05 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 1G" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:05 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 Jul 09 05:16:05 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:05 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4" returned: 0 in 0.662s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:05 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 is being set with open permissions: ugo+rw Jul 09 05:16:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:05 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 Jul 09 05:16:05 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:06 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4" returned: 0 in 0.616s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:06 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.info Jul 09 05:16:06 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:07 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.info" returned: 0 in 0.671s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:07 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.info is being set with open permissions: ugo+rw Jul 09 05:16:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:07 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.info Jul 09 05:16:07 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:07 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.info" returned: 0 in 0.647s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.236s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-49010f46-5f20-4734-88f0-d26f793cc753 tempest-VolumesSnapshotTestJSON-2028010313 None] Create snapshot completed successfully Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Flow 'volume_create_manager' (f80e2ecc-6275-49f4-bc91-f639daa0a952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a63256e-c391-447e-adcb-a6463187fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a63256e-c391-447e-adcb-a6463187fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1358441374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316cbeac-ee16-4948-9987-31f7e3a805a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23191ef9e5854a439c5c706fb03062e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2167a9ff-7532-45b7-8e7f-31fc3c7e71b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:16:09Z,use_quota=True,user_id='e561302437a94a1ea00aa48f06cb0815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820a3382-e7a7-46ff-9e40-89ef09b99201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820a3382-e7a7-46ff-9e40-89ef09b99201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a53e8e-0b6c-4d8d-a4eb-285adf07b943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a53e8e-0b6c-4d8d-a4eb-285adf07b943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '316cbeac-ee16-4948-9987-31f7e3a805a1', 'volume_name': 'volume-316cbeac-ee16-4948-9987-31f7e3a805a1', 'volume_size': 1, 'snapshot_id': '2167a9ff-7532-45b7-8e7f-31fc3c7e71b4'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8f8698-361d-41c9-96ed-3bce8df43a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8f8698-361d-41c9-96ed-3bce8df43a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e4b47a-320f-4e15-b403-58cc5ed2b104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:09 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Volume 316cbeac-ee16-4948-9987-31f7e3a805a1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-316cbeac-ee16-4948-9987-31f7e3a805a1', 'volume_size': 1, 'snapshot_id': '2167a9ff-7532-45b7-8e7f-31fc3c7e71b4'} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-2167a9ff-7532-45b7-8e7f-31fc3c7e71b4-316cbeac-ee16-4948-9987-31f7e3a805a1" by "_create_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-2167a9ff-7532-45b7-8e7f-31fc3c7e71b4-316cbeac-ee16-4948-9987-31f7e3a805a1" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Creating volume 316cbeac-ee16-4948-9987-31f7e3a805a1 from snapshot 2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 {{(pid=87161) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-316cbeac-ee16-4948-9987-31f7e3a805a1" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-316cbeac-ee16-4948-9987-31f7e3a805a1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] snapshot: 2167a9ff-7532-45b7-8e7f-31fc3c7e71b4, volume: 316cbeac-ee16-4948-9987-31f7e3a805a1, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa10d2a2-e477-4bd1-8c9a-0b63b2e5e125]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:16:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:09 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 Jul 09 05:16:09 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:10 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4" returned: 0 in 0.754s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:16:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:16:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:16:10 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d828557-db22-4049-a542-5fbd5f426b07]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:16:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:10 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 Jul 09 05:16:10 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:10 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89" returned: 0 in 0.756s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:10 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:16:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:10 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 Jul 09 05:16:10 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:15 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1" returned: 0 in 4.335s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:15 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bbfcf7-4056-4f51-8ff3-d1deb9a88834]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:16:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:15 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 Jul 09 05:16:15 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:16 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89" returned: 0 in 0.904s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:16:16 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Converted 1024.00 MB image at 236.16 MB/s Jul 09 05:16:16 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 is being set with open permissions: ugo+rw Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:16 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 Jul 09 05:16:16 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:16 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1" returned: 0 in 0.631s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-316cbeac-ee16-4948-9987-31f7e3a805a1" released by "_copy_volume_from_snapshot" :: held 7.470s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-2167a9ff-7532-45b7-8e7f-31fc3c7e71b4-316cbeac-ee16-4948-9987-31f7e3a805a1" released by "_create_volume_from_snapshot" :: held 7.497s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.511s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=75,cinder:SELECT=75,cinder:DELETE=5,cinder:INSERT=15 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e4b47a-320f-4e15-b403-58cc5ed2b104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-316cbeac-ee16-4948-9987-31f7e3a805a1', 'volume_size': 1, 'snapshot_id': '2167a9ff-7532-45b7-8e7f-31fc3c7e71b4'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea354b8b-b04b-45c5-9f1a-72fdbac2bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:16:16 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Volume volume-316cbeac-ee16-4948-9987-31f7e3a805a1 (316cbeac-ee16-4948-9987-31f7e3a805a1): created successfully Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea354b8b-b04b-45c5-9f1a-72fdbac2bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:16:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Flow 'volume_create_manager' (f80e2ecc-6275-49f4-bc91-f639daa0a952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:16:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4018adb8-0990-4e2b-8dd4-144fd67e9aa7 tempest-VolumesSnapshotTestJSON-2028010313 None] Created volume successfully. Jul 09 05:16:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-316cbeac-ee16-4948-9987-31f7e3a805a1-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-316cbeac-ee16-4948-9987-31f7e3a805a1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-316cbeac-ee16-4948-9987-31f7e3a805a1" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-316cbeac-ee16-4948-9987-31f7e3a805a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:17 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[117ba3b7-6e3b-49a3-8f4b-c99e1241c56f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:16:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:18 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 Jul 09 05:16:18 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:18 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1" returned: 0 in 0.733s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:18 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1 Jul 09 05:16:18 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:19 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-316cbeac-ee16-4948-9987-31f7e3a805a1" returned: 0 in 0.633s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-316cbeac-ee16-4948-9987-31f7e3a805a1" released by "delete_volume" :: held 1.405s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:19 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Created reservations ['ee010c13-2675-417b-80d7-6046b3b1a21c', '72899854-4445-4780-a55e-94804936fc84', '669fe327-2bfc-4d26-92fb-512d3b488436', '6a8dd541-b47e-467d-9cf2-2063ff58610a'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:16:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:16:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:16:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:19 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:16:19 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:20 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.632s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:16:20 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Deleted volume successfully. Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f6d64c97-8eca-4c75-a7cc-e79f788e354f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-316cbeac-ee16-4948-9987-31f7e3a805a1-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-2167a9ff-7532-45b7-8e7f-31fc3c7e71b4-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-2167a9ff-7532-45b7-8e7f-31fc3c7e71b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-5bb141e9-129e-44ba-93ed-ecdc9550ab89" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-5bb141e9-129e-44ba-93ed-ecdc9550ab89" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-2167a9ff-7532-45b7-8e7f-31fc3c7e71b4" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-2167a9ff-7532-45b7-8e7f-31fc3c7e71b4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Deleting offline snapshot 2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 of volume 5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] snapshot_file for this snap is: volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14af937-be61-474a-ab15-9eb4c780726f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:20 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 Jul 09 05:16:20 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:20 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4" returned: 0 in 0.733s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[61383d34-0a51-4ac8-a3d4-cc371c788766]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:16:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:21 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 Jul 09 05:16:21 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:21 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89" returned: 0 in 0.725s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:21 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 Jul 09 05:16:21 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:22 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4" returned: 0 in 0.715s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:22 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4 Jul 09 05:16:22 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:22 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89.2167a9ff-7532-45b7-8e7f-31fc3c7e71b4" returned: 0 in 0.621s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-2167a9ff-7532-45b7-8e7f-31fc3c7e71b4" released by "_delete_snapshot" :: held 2.885s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-5bb141e9-129e-44ba-93ed-ecdc9550ab89" released by "delete_snapshot" :: held 2.906s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:23 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Created reservations ['61d63473-a830-4f4f-bd7a-b556d75b335c', 'f97fb2b9-6d2e-4468-8c2a-695c2141a75a', 'bf2f66aa-2202-4205-ac42-ee7f5bdcd33d', '5fdda9fd-3772-451b-94f2-0ba44a10878c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:16:23 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Delete snapshot completed successfully. Jul 09 05:16:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a9d01319-cf09-4482-8de8-047ad1ddc941 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-2167a9ff-7532-45b7-8e7f-31fc3c7e71b4-delete_snapshot" released by "delete_snapshot" :: held 3.035s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-5bb141e9-129e-44ba-93ed-ecdc9550ab89-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-5bb141e9-129e-44ba-93ed-ecdc9550ab89-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-5bb141e9-129e-44ba-93ed-ecdc9550ab89" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-5bb141e9-129e-44ba-93ed-ecdc9550ab89" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:23 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4619a6c1-1a10-4d90-a673-a4aca9b61ae6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:16:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:23 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 Jul 09 05:16:23 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:24 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89" returned: 0 in 0.729s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:24 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89 Jul 09 05:16:24 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:24 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5bb141e9-129e-44ba-93ed-ecdc9550ab89" returned: 0 in 0.649s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-5bb141e9-129e-44ba-93ed-ecdc9550ab89" released by "delete_volume" :: held 1.435s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Created reservations ['7d77fa61-8892-4ddd-9853-1362e3164e2d', '58789fa2-09ec-4dff-8589-00e6cb285e9b', '1b36ddc2-3ec2-4e14-b4be-742577e67f1e', 'a684793b-b398-4a47-a061-12ea48e78d2c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:24 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:16:24 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:25 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.646s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:25 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:16:25 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Deleted volume successfully. Jul 09 05:16:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e4a841a3-9b4b-4d40-bd38-7ad784fc1e9f tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-5bb141e9-129e-44ba-93ed-ecdc9550ab89-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-6d01d55f-6ed6-4b00-9b48-e6b6724a233b-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-6d01d55f-6ed6-4b00-9b48-e6b6724a233b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "cinder-quobyte-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:16:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:16:25 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f3c651-12b3-448c-9463-46003db96cad]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:16:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:25 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b Jul 09 05:16:25 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:26 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" returned: 0 in 0.727s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:26 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b Jul 09 05:16:26 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:27 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" returned: 0 in 0.629s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-quobyte-6d01d55f-6ed6-4b00-9b48-e6b6724a233b" released by "delete_volume" :: held 1.412s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Created reservations ['9faee35f-052c-46ab-b22c-6515c83d8c88', '23528ae6-dbbc-4cdc-9990-3ea5ab96fd8e', '1c0847ae-ec1e-4b83-9fbc-7f426ee0ef8e', 'ba0db8aa-2222-4bc3-85f9-1bb4444a2e4f'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:27 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:16:27 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:27 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.616s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:16:27 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Deleted volume successfully. Jul 09 05:16:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-a62ab678-6b08-4b44-9aef-4edae5387171 tempest-VolumesSnapshotTestJSON-2028010313 None] Lock "cinder-6d01d55f-6ed6-4b00-9b48-e6b6724a233b-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:16:37 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=40,cinder:INSERT=16,cinder:UPDATE=54,cinder:DELETE=2 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:16:37 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:DELETE=4,cinder:UPDATE=30,cinder:SELECT=22,cinder:INSERT=7 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:16:39 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:16:39 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:16:39 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.726s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:16:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:16:48 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:16:48 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Flow 'volume_create_manager' (ca004504-c56b-4bf0-94b3-1c8cda3f0bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7ecc85-39e8-4639-a790-0e103aee2bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7ecc85-39e8-4639-a790-0e103aee2bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-612393039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7274f401-31b3-42ed-8770-4e97a1c7f961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cf070e17214d6ba80992efa0b44039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:17:06Z,use_quota=True,user_id='3578e51cc9024750979e7bcb84df2e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2a3c8f-a27d-42e2-bf2c-af27a68bc5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2a3c8f-a27d-42e2-bf2c-af27a68bc5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8764390d-e709-4acd-87a4-b19e6401f366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8764390d-e709-4acd-87a4-b19e6401f366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7274f401-31b3-42ed-8770-4e97a1c7f961', 'volume_name': 'volume-7274f401-31b3-42ed-8770-4e97a1c7f961', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958f2e84-a8b2-4422-b11a-b1a3d9d0e64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958f2e84-a8b2-4422-b11a-b1a3d9d0e64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e9c0fa-cf2d-464d-8130-cba9d631a958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:17:06 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Volume 7274f401-31b3-42ed-8770-4e97a1c7f961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7274f401-31b3-42ed-8770-4e97a1c7f961', 'volume_size': 1} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-612393039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7274f401-31b3-42ed-8770-4e97a1c7f961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cf070e17214d6ba80992efa0b44039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:17:06Z,use_quota=True,user_id='3578e51cc9024750979e7bcb84df2e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Creating volume 7274f401-31b3-42ed-8770-4e97a1c7f961 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:17:06 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:17:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:17:06 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 1073741824 Jul 09 05:17:06 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:17:07 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Jul 09 05:17:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 1073741824" returned: 0 in 0.847s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:17:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:17:07 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 Jul 09 05:17:07 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:17:08 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 09 05:17:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961" returned: 0 in 0.689s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:17:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:17:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:17:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e9c0fa-cf2d-464d-8130-cba9d631a958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7274f401-31b3-42ed-8770-4e97a1c7f961', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:17:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf69c1b6-9adb-4297-80a9-c058297407e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:17:08 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Volume volume-7274f401-31b3-42ed-8770-4e97a1c7f961 (7274f401-31b3-42ed-8770-4e97a1c7f961): created successfully Jul 09 05:17:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf69c1b6-9adb-4297-80a9-c058297407e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:17:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Flow 'volume_create_manager' (ca004504-c56b-4bf0-94b3-1c8cda3f0bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:17:08 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1d3d19e4-0c01-46f3-be20-b071af4f01b9 tempest-TestMinimumBasicScenario-1659125209 None] Created volume successfully. Jul 09 05:17:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ee887290-365d-4db9-860d-e1c377d904f1 req-298b607e-2c20-4649-94e2-454549e58449 tempest-TestMinimumBasicScenario-1659125209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:17:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ee887290-365d-4db9-860d-e1c377d904f1 req-298b607e-2c20-4649-94e2-454549e58449 tempest-TestMinimumBasicScenario-1659125209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:17:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8323abaa-f850-4dc8-a480-873fcf22ebc1]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:17:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ee887290-365d-4db9-860d-e1c377d904f1 req-298b607e-2c20-4649-94e2-454549e58449 tempest-TestMinimumBasicScenario-1659125209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:17:12 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 Jul 09 05:17:12 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:17:12 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 09 05:17:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-ee887290-365d-4db9-860d-e1c377d904f1 req-298b607e-2c20-4649-94e2-454549e58449 tempest-TestMinimumBasicScenario-1659125209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961" returned: 0 in 0.779s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:17:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-ee887290-365d-4db9-860d-e1c377d904f1 req-298b607e-2c20-4649-94e2-454549e58449 tempest-TestMinimumBasicScenario-1659125209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:17:12 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-ee887290-365d-4db9-860d-e1c377d904f1 req-298b607e-2c20-4649-94e2-454549e58449 tempest-TestMinimumBasicScenario-1659125209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-7274f401-31b3-42ed-8770-4e97a1c7f961', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d8f7377-b617-4e11-a049-f8ad3e514e17', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:17:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-ee887290-365d-4db9-860d-e1c377d904f1 req-298b607e-2c20-4649-94e2-454549e58449 tempest-TestMinimumBasicScenario-1659125209 None] attachment_update completed successfully. Jul 09 05:17:23 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:17:23 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10,cinder:DELETE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:17:39 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:17:39 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:17:39 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.636s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:17:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:17:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-59e432af-8b06-4b76-8559-02ed0a56594c req-3bf12f7b-9330-49dd-92f8-a99466f7ed3e tempest-TestMinimumBasicScenario-1659125209 None] Terminate volume connection completed successfully. Jul 09 05:17:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-59e432af-8b06-4b76-8559-02ed0a56594c req-3bf12f7b-9330-49dd-92f8-a99466f7ed3e tempest-TestMinimumBasicScenario-1659125209 None] Deleting attachment 9d8f7377-b617-4e11-a049-f8ad3e514e17. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:18:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Acquiring lock "cinder-7274f401-31b3-42ed-8770-4e97a1c7f961-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:18:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Lock "cinder-7274f401-31b3-42ed-8770-4e97a1c7f961-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:18:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Acquiring lock "cinder-quobyte-7274f401-31b3-42ed-8770-4e97a1c7f961" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:18:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Lock "cinder-quobyte-7274f401-31b3-42ed-8770-4e97a1c7f961" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:18:00 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa63bd4-fa4b-449c-b42b-faec11b062e3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:18:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:00 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 Jul 09 05:18:00 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:00 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961" returned: 0 in 0.746s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:00 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961 Jul 09 05:18:00 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:01 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-7274f401-31b3-42ed-8770-4e97a1c7f961" returned: 0 in 0.627s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Lock "cinder-quobyte-7274f401-31b3-42ed-8770-4e97a1c7f961" released by "delete_volume" :: held 1.408s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:18:01 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Created reservations ['3c310b99-ef2a-44ae-a1b8-2432ba0a6dc6', '4e6b43c0-85de-4b18-8f33-c023b47a6a55', '5364fad6-bb42-46b2-9314-b9705567e122', '0ca0fada-1fb1-4580-b088-2ddfbeca9b10'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:18:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:18:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:18:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:18:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:18:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:18:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:01 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:18:01 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:02 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.630s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:02 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:18:02 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Deleted volume successfully. Jul 09 05:18:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-623eb4db-9a2d-4fd0-a67f-088dd3cce98b tempest-TestMinimumBasicScenario-1659125209 None] Lock "cinder-7274f401-31b3-42ed-8770-4e97a1c7f961-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:18:11 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:18:12 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:18:38 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:18:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Flow 'volume_create_manager' (8986516d-65f3-4b8b-9e88-76ac5a5562f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:18:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05564e32-28a4-4cc7-9521-596bb26b528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:18:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05564e32-28a4-4cc7-9521-596bb26b528f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1722630707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364db921-faf5-4143-b9eb-042b07faa5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56375ff120984907b7b930340a4a79f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:18:39Z,use_quota=True,user_id='f82c0e07dd7941d0b7bfa30ef70121ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:18:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de7601f-f505-455e-a4bf-8641fc251e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:18:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de7601f-f505-455e-a4bf-8641fc251e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:18:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0961cde-64ec-44df-8f52-44dd7a34bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:18:38 devstack cinder-volume[87161]: DEBUG cinder.image.glance [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Creating Keystone auth plugin from conf {{(pid=87161) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0961cde-64ec-44df-8f52-44dd7a34bc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '364db921-faf5-4143-b9eb-042b07faa5da', 'volume_name': 'volume-364db921-faf5-4143-b9eb-042b07faa5da', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaa9488-e9a3-4d47-a1ef-c9a956da3936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaa9488-e9a3-4d47-a1ef-c9a956da3936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e13968-8d41-4d8f-9713-1436a17230ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:18:39 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Volume 364db921-faf5-4143-b9eb-042b07faa5da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-364db921-faf5-4143-b9eb-042b07faa5da', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Trying to clone 364db921-faf5-4143-b9eb-042b07faa5da from image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]). {{(pid=87161) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:39 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:18:39 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 05:18:39 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Image download 20.69 MB at 20.69 MB/s Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe85eb0-f2d9-4612-b221-db71f5f0b78a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:39 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD Jul 09 05:18:39 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:39 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.677s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:18:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:18:40 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Temporary image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 is fetched for user f82c0e07dd7941d0b7bfa30ef70121ca. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4654931e-d06a-4f62-a3f1-e9c9ff7249e2]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:40 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD Jul 09 05:18:40 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:40 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1722630707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364db921-faf5-4143-b9eb-042b07faa5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56375ff120984907b7b930340a4a79f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:18:39Z,use_quota=True,user_id='f82c0e07dd7941d0b7bfa30ef70121ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Creating volume 364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:18:40 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:18:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:40 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da 1073741824 Jul 09 05:18:40 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:41 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da 1073741824" returned: 0 in 0.879s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:41 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:18:41 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:42 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 0 in 0.642s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:18:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:18:42 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Attempting download of dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}])) to volume 364db921-faf5-4143-b9eb-042b07faa5da. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 05:18:42 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d048ac-1e96-4e23-a766-303eaa9cf125]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:18:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_uyjqd0ka {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:42 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_uyjqd0ka Jul 09 05:18:42 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:43 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_uyjqd0ka" returned: 0 in 0.711s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_uyjqd0ka {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:43 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_uyjqd0ka Jul 09 05:18:43 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:43 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_uyjqd0ka" returned: 1 in 0.709s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_uyjqd0ka' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:18:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[be160a20-8d3d-4985-ae61-d4b25e3189f3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:18:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:44 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD Jul 09 05:18:44 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:44 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD" returned: 0 in 0.704s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:44 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 was qcow2, converting to raw {{(pid=87161) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 05:18:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:44 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:18:44 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:46 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 0 in 1.761s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:46 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dbf1b5d6-a399-40e2-8a19-aa11cd2e4039_6hoqd63kdevstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:18:46 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Converted 112.00 MB image at 63.56 MB/s Jul 09 05:18:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:46 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da 1G Jul 09 05:18:46 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:47 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da 1G" returned: 0 in 0.670s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:47 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[119daab2-58e6-4121-af04-559ce2a12584]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:18:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:47 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:18:47 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:47 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 0 in 0.723s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:47 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:18:47 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:48 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 1 in 0.722s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Downloaded image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}])) to volume 364db921-faf5-4143-b9eb-042b07faa5da successfully. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Temporary image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 for user f82c0e07dd7941d0b7bfa30ef70121ca is deleted. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Marking volume 364db921-faf5-4143-b9eb-042b07faa5da as bootable. {{(pid=87161) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Copying metadata from image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 to 364db921-faf5-4143-b9eb-042b07faa5da. {{(pid=87161) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Creating volume glance metadata for volume 364db921-faf5-4143-b9eb-042b07faa5da backed by image dbf1b5d6-a399-40e2-8a19-aa11cd2e4039 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87161) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e13968-8d41-4d8f-9713-1436a17230ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364db921-faf5-4143-b9eb-042b07faa5da', 'volume_size': 1, 'image_id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e702fc0e948541a5a76a68ffa055478f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dbf1b5d6-a399-40e2-8a19-aa11cd2e4039', 'created_at': datetime.datetime(2026, 7, 9, 2, 51, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 2, 51, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbf1b5d6-a399-40e2-8a19-aa11cd2e4039/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360628a3-2f2b-424c-9659-d56568da212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:18:48 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Volume volume-364db921-faf5-4143-b9eb-042b07faa5da (364db921-faf5-4143-b9eb-042b07faa5da): created successfully Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360628a3-2f2b-424c-9659-d56568da212e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:18:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Flow 'volume_create_manager' (8986516d-65f3-4b8b-9e88-76ac5a5562f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:18:48 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9cd285b4-5915-4566-a787-4840c6fc392b tempest-TestShelveInstance-1504797760 None] Created volume successfully. Jul 09 05:18:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-d6e690f3-2483-4dd6-a68b-0f2997442b62 req-30758ec7-5c3c-422a-b98e-d724d3371a36 tempest-TestShelveInstance-1504797760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:18:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-d6e690f3-2483-4dd6-a68b-0f2997442b62 req-30758ec7-5c3c-422a-b98e-d724d3371a36 tempest-TestShelveInstance-1504797760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:18:58 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[23005ea3-4d05-48da-9d33-27d810afb56c]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:18:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-d6e690f3-2483-4dd6-a68b-0f2997442b62 req-30758ec7-5c3c-422a-b98e-d724d3371a36 tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:58 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:18:58 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:18:59 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 09 05:18:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-d6e690f3-2483-4dd6-a68b-0f2997442b62 req-30758ec7-5c3c-422a-b98e-d724d3371a36 tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 0 in 0.753s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:18:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-d6e690f3-2483-4dd6-a68b-0f2997442b62 req-30758ec7-5c3c-422a-b98e-d724d3371a36 tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:18:59 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:18:59 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:19:00 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Jul 09 05:19:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-d6e690f3-2483-4dd6-a68b-0f2997442b62 req-30758ec7-5c3c-422a-b98e-d724d3371a36 tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 1 in 0.754s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:19:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-d6e690f3-2483-4dd6-a68b-0f2997442b62 req-30758ec7-5c3c-422a-b98e-d724d3371a36 tempest-TestShelveInstance-1504797760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:19:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-d6e690f3-2483-4dd6-a68b-0f2997442b62 req-30758ec7-5c3c-422a-b98e-d724d3371a36 tempest-TestShelveInstance-1504797760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.552s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:19:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-d6e690f3-2483-4dd6-a68b-0f2997442b62 req-30758ec7-5c3c-422a-b98e-d724d3371a36 tempest-TestShelveInstance-1504797760 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-364db921-faf5-4143-b9eb-042b07faa5da', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7163774-9e63-42ef-9bf6-206a2f636eb5', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:19:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-d6e690f3-2483-4dd6-a68b-0f2997442b62 req-30758ec7-5c3c-422a-b98e-d724d3371a36 tempest-TestShelveInstance-1504797760 None] attachment_update completed successfully. Jul 09 05:19:10 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=8,cinder:SELECT=15,cinder:INSERT=5 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:19:10 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=16,cinder:INSERT=9,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:19:36 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-69afd2b5-b870-4055-9abe-7c044ccc5b55 req-ae4608af-ce90-45c2-bed2-632f3e6897c8 tempest-TestShelveInstance-1504797760 None] Terminate volume connection completed successfully. Jul 09 05:19:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-69afd2b5-b870-4055-9abe-7c044ccc5b55 req-ae4608af-ce90-45c2-bed2-632f3e6897c8 tempest-TestShelveInstance-1504797760 None] Deleting attachment a7163774-9e63-42ef-9bf6-206a2f636eb5. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:19:39 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:19:39 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:19:39 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.668s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:19:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:19:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6a6edaf6-37d0-4376-a80d-0b43cc8c1e0c req-08df5566-3077-48c6-8375-64bdbe587489 tempest-TestShelveInstance-1504797760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:19:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6a6edaf6-37d0-4376-a80d-0b43cc8c1e0c req-08df5566-3077-48c6-8375-64bdbe587489 tempest-TestShelveInstance-1504797760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:19:41 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d63cd2a-67b6-424d-9a33-d03d7153c45e]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:19:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6a6edaf6-37d0-4376-a80d-0b43cc8c1e0c req-08df5566-3077-48c6-8375-64bdbe587489 tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:19:41 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:19:41 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:19:41 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jul 09 05:19:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6a6edaf6-37d0-4376-a80d-0b43cc8c1e0c req-08df5566-3077-48c6-8375-64bdbe587489 tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 0 in 0.731s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:19:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6a6edaf6-37d0-4376-a80d-0b43cc8c1e0c req-08df5566-3077-48c6-8375-64bdbe587489 tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:19:42 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:19:42 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:19:42 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 09 05:19:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6a6edaf6-37d0-4376-a80d-0b43cc8c1e0c req-08df5566-3077-48c6-8375-64bdbe587489 tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 1 in 0.759s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:19:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-6a6edaf6-37d0-4376-a80d-0b43cc8c1e0c req-08df5566-3077-48c6-8375-64bdbe587489 tempest-TestShelveInstance-1504797760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:19:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-6a6edaf6-37d0-4376-a80d-0b43cc8c1e0c req-08df5566-3077-48c6-8375-64bdbe587489 tempest-TestShelveInstance-1504797760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.528s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:19:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-6a6edaf6-37d0-4376-a80d-0b43cc8c1e0c req-08df5566-3077-48c6-8375-64bdbe587489 tempest-TestShelveInstance-1504797760 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b', 'name': 'volume-364db921-faf5-4143-b9eb-042b07faa5da', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a26f788b-600d-4615-b617-dd6705f00e49', 'enforce_multipath': True} {{(pid=87161) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 05:19:42 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-6a6edaf6-37d0-4376-a80d-0b43cc8c1e0c req-08df5566-3077-48c6-8375-64bdbe587489 tempest-TestShelveInstance-1504797760 None] attachment_update completed successfully. Jul 09 05:19:52 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:19:52 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:20:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-7732cf32-ecbd-4584-bbea-bbd14dbce494 tempest-TestShelveInstance-1504797760 None] Terminate volume connection completed successfully. Jul 09 05:20:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-7732cf32-ecbd-4584-bbea-bbd14dbce494 tempest-TestShelveInstance-1504797760 None] Deleting attachment a26f788b-600d-4615-b617-dd6705f00e49. {{(pid=87161) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 05:20:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Acquiring lock "cinder-364db921-faf5-4143-b9eb-042b07faa5da-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:20:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Lock "cinder-364db921-faf5-4143-b9eb-042b07faa5da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:20:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Acquiring lock "cinder-quobyte-364db921-faf5-4143-b9eb-042b07faa5da" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:20:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Lock "cinder-quobyte-364db921-faf5-4143-b9eb-042b07faa5da" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:20:19 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fffd13-9a33-4eb3-b7df-94da44d8b4dc]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:20:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:19 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:20:19 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:20 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 0 in 0.762s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:20 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:20:20 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:21 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 1 in 0.762s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:20:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:21 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da Jul 09 05:20:21 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:22 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-364db921-faf5-4143-b9eb-042b07faa5da" returned: 0 in 0.644s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Lock "cinder-quobyte-364db921-faf5-4143-b9eb-042b07faa5da" released by "delete_volume" :: held 2.229s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG cinder.quota [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Created reservations ['aec48396-6bd8-4db6-b7d5-013ab785cecb', 'a98fffdf-ecd4-46e8-aee1-90ea6b75e98d', '90ef4d9b-1e84-4a20-824f-f10b6dc40a71', 'c03607f7-0743-45a3-a37c-4093f8f34e4e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:22 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:20:22 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:22 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.689s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG cinder.manager [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:20:22 devstack cinder-volume[87161]: INFO cinder.volume.manager [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Deleted volume successfully. Jul 09 05:20:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [req-bfef4c42-6b10-4c25-b59a-abdbfec0b1ed req-209c00e4-99cd-457e-b2b0-a6f8a53be228 tempest-TestShelveInstance-1504797760 None] Lock "cinder-364db921-faf5-4143-b9eb-042b07faa5da-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:20:32 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:20:32 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Flow 'volume_create_manager' (04b8e53a-dd41-4b11-afdb-79c228ab4ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2167f6c-0c56-4724-90b9-be4384487cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2167f6c-0c56-4724-90b9-be4384487cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47937259607f4862b8343c60794aeddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:20:35Z,use_quota=True,user_id='101bc9b6768f4108b58125b99fda6dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e8b3964-08e4-4cfc-b048-14255c90d40e),volume_type_id=3e8b3964-08e4-4cfc-b048-14255c90d40e)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e8beda-1b94-4883-a297-ce919ab748b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e8beda-1b94-4883-a297-ce919ab748b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b774fb-1c39-468f-bcd1-926b9bb7ea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.image.glance [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Creating Keystone auth plugin from conf {{(pid=87161) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b774fb-1c39-468f-bcd1-926b9bb7ea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf', 'volume_name': 'volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf', 'volume_size': 1, 'image_id': '56230829-0200-41a2-a887-844d2201f49d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56230829-0200-41a2-a887-844d2201f49d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53399df6794b38397f4b7f82442a3212', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47937259607f4862b8343c60794aeddc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99d807957c60e0c44cd5006c5226c3e2f66cb89b3338381cc9a8c8677f43a404d2ffe171f2fc586196f10fbc8fa13e14479fa6c895c0cf136631bf7c41f3c056', 'id': '56230829-0200-41a2-a887-844d2201f49d', 'created_at': datetime.datetime(2026, 7, 9, 3, 20, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 20, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56230829-0200-41a2-a887-844d2201f49d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cac506-d6a7-4e50-9a05-afedd4bd59e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cac506-d6a7-4e50-9a05-afedd4bd59e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5caa325-c7a8-4cf2-b473-c2b2ba1d043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:35 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Volume c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf', 'volume_size': 1, 'image_id': '56230829-0200-41a2-a887-844d2201f49d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56230829-0200-41a2-a887-844d2201f49d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53399df6794b38397f4b7f82442a3212', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47937259607f4862b8343c60794aeddc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99d807957c60e0c44cd5006c5226c3e2f66cb89b3338381cc9a8c8677f43a404d2ffe171f2fc586196f10fbc8fa13e14479fa6c895c0cf136631bf7c41f3c056', 'id': '56230829-0200-41a2-a887-844d2201f49d', 'created_at': datetime.datetime(2026, 7, 9, 3, 20, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 20, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56230829-0200-41a2-a887-844d2201f49d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Trying to clone c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf from image 56230829-0200-41a2-a887-844d2201f49d at location (None, [{'url': 'file:///opt/stack/data/glance/images/56230829-0200-41a2-a887-844d2201f49d', 'metadata': {}}]). {{(pid=87161) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 05:20:35 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Image download 0.00 MB at 0.00 MB/s Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beab989-1c86-421c-afba-619570345eaf]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:20:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:36 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD Jul 09 05:20:36 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:36 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:36 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD Jul 09 05:20:36 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:37 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD" returned: 1 in 0.714s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:20:37 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Temporary image 56230829-0200-41a2-a887-844d2201f49d is fetched for user 101bc9b6768f4108b58125b99fda6dcb. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 05:20:37 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2333a3-bcb5-4df4-b7ee-b84da9884a83]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:20:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:37 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD Jul 09 05:20:37 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:38 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:38 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD Jul 09 05:20:38 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:38 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD" returned: 1 in 0.736s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47937259607f4862b8343c60794aeddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:20:35Z,use_quota=True,user_id='101bc9b6768f4108b58125b99fda6dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e8b3964-08e4-4cfc-b048-14255c90d40e),volume_type_id=3e8b3964-08e4-4cfc-b048-14255c90d40e)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Creating volume c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:20:38 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:20:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:38 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf 1073741824 Jul 09 05:20:38 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:39 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:20:39 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:39 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf 1073741824" returned: 0 in 0.798s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:39 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.669s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:20:39 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf Jul 09 05:20:39 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:20:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:20:40 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf" returned: 0 in 0.615s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:20:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:20:40 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Attempting download of 56230829-0200-41a2-a887-844d2201f49d ((None, [{'url': 'file:///opt/stack/data/glance/images/56230829-0200-41a2-a887-844d2201f49d', 'metadata': {}}])) to volume c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 05:20:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[167d65ac-994e-41fb-af7b-e32115898479]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:20:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56230829-0200-41a2-a887-844d2201f49d_8h9r8lio {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:40 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56230829-0200-41a2-a887-844d2201f49d_8h9r8lio Jul 09 05:20:40 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:41 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56230829-0200-41a2-a887-844d2201f49d_8h9r8lio" returned: 0 in 0.710s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56230829-0200-41a2-a887-844d2201f49d_8h9r8lio {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:41 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56230829-0200-41a2-a887-844d2201f49d_8h9r8lio Jul 09 05:20:41 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:41 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56230829-0200-41a2-a887-844d2201f49d_8h9r8lio" returned: 1 in 0.720s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56230829-0200-41a2-a887-844d2201f49d_8h9r8lio' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:20:41 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8c4dd9-3cef-4df5-b5e3-e7ab38863224]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:20:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:41 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD Jul 09 05:20:41 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:42 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD" returned: 0 in 0.699s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:42 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD Jul 09 05:20:42 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:43 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD" returned: 1 in 0.733s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:20:43 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] 56230829-0200-41a2-a887-844d2201f49d was raw, converting to raw {{(pid=87161) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 05:20:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:43 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf Jul 09 05:20:43 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:43 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf" returned: 0 in 0.697s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:43 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_56230829-0200-41a2-a887-844d2201f49d_92i5m8ehdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:20:43 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 05:20:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:44 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf 1G Jul 09 05:20:44 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:44 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf 1G" returned: 0 in 0.655s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:44 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9191976c-178e-4a38-9277-6e39a2a66a05]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:20:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:44 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf Jul 09 05:20:44 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:45 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf" returned: 0 in 0.733s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:45 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf Jul 09 05:20:45 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:46 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf" returned: 1 in 0.734s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Downloaded image 56230829-0200-41a2-a887-844d2201f49d ((None, [{'url': 'file:///opt/stack/data/glance/images/56230829-0200-41a2-a887-844d2201f49d', 'metadata': {}}])) to volume c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf successfully. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Temporary image 56230829-0200-41a2-a887-844d2201f49d for user 101bc9b6768f4108b58125b99fda6dcb is deleted. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Marking volume c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf as bootable. {{(pid=87161) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Copying metadata from image 56230829-0200-41a2-a887-844d2201f49d to c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf. {{(pid=87161) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Creating volume glance metadata for volume c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf backed by image 56230829-0200-41a2-a887-844d2201f49d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '56230829-0200-41a2-a887-844d2201f49d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '53399df6794b38397f4b7f82442a3212', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87161) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5caa325-c7a8-4cf2-b473-c2b2ba1d043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf', 'volume_size': 1, 'image_id': '56230829-0200-41a2-a887-844d2201f49d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56230829-0200-41a2-a887-844d2201f49d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53399df6794b38397f4b7f82442a3212', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47937259607f4862b8343c60794aeddc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99d807957c60e0c44cd5006c5226c3e2f66cb89b3338381cc9a8c8677f43a404d2ffe171f2fc586196f10fbc8fa13e14479fa6c895c0cf136631bf7c41f3c056', 'id': '56230829-0200-41a2-a887-844d2201f49d', 'created_at': datetime.datetime(2026, 7, 9, 3, 20, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 20, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56230829-0200-41a2-a887-844d2201f49d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200083fd-b9ac-40bb-9eec-49f2f47e6ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:46 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Volume volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf (c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf): created successfully Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200083fd-b9ac-40bb-9eec-49f2f47e6ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Flow 'volume_create_manager' (04b8e53a-dd41-4b11-afdb-79c228ab4ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:20:46 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-172e3e15-b608-42b3-beb2-6e1156939134 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Created volume successfully. Jul 09 05:20:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Acquiring lock "cinder-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:20:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Lock "cinder-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:20:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Acquiring lock "cinder-quobyte-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:20:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Lock "cinder-quobyte-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:20:47 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bcb4fd-9ed0-49c1-a88b-ab879cd66a3f]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:20:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:47 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf Jul 09 05:20:47 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:47 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf" returned: 0 in 0.736s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:48 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf Jul 09 05:20:48 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:48 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf" returned: 1 in 0.730s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:20:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:48 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf Jul 09 05:20:48 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:49 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf" returned: 0 in 0.623s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Lock "cinder-quobyte-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf" released by "delete_volume" :: held 2.144s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:20:49 devstack cinder-volume[87161]: WARNING cinder.quota [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:20:49 devstack cinder-volume[87161]: WARNING cinder.quota [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 05:20:49 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Created reservations ['e8c03101-b3a9-407e-845c-d6b3e5a84171', 'd538242c-c610-4a64-a02c-569755b9d13d', 'c50b9225-7c3e-4e26-b97f-a61989c67dd9', '8cfc11f0-ac71-4836-b1be-67b3868c9d22'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:20:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:20:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:20:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:20:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:20:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:20:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:49 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:20:49 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:50 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.617s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:50 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:20:50 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Deleted volume successfully. Jul 09 05:20:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b541ff5b-c399-475f-b85a-e8b382da0c75 tempest-VolumeAndVolumeTypeFromImageTest-1689376996 None] Lock "cinder-c66fa7ce-c153-49b2-82f6-b8c80bbe2ecf-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (be0b345a-3503-4b68-a242-faa0f405c117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805b3566-8553-4bdb-afcf-b589c377a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805b3566-8553-4bdb-afcf-b589c377a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1236789426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb2a968-bc62-4614-b43b-abf0a4ab3945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:20:54Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cdc37f-4c68-44e2-94a8-20e0607d4612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cdc37f-4c68-44e2-94a8-20e0607d4612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c904b04-512b-47ac-a738-325a72966cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c904b04-512b-47ac-a738-325a72966cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb2a968-bc62-4614-b43b-abf0a4ab3945', 'volume_name': 'volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84497125-038e-4f39-ae48-43a8a91ab46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84497125-038e-4f39-ae48-43a8a91ab46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41277a01-a20c-4066-993f-05c7f50a8ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:54 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume 1eb2a968-bc62-4614-b43b-abf0a4ab3945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945', 'volume_size': 1} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1236789426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb2a968-bc62-4614-b43b-abf0a4ab3945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:20:54Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Creating volume 1eb2a968-bc62-4614-b43b-abf0a4ab3945 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:20:54 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:20:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:54 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 1073741824 Jul 09 05:20:54 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:55 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 1073741824" returned: 0 in 0.803s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:55 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 Jul 09 05:20:55 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:55 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945" returned: 0 in 0.613s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:20:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:20:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41277a01-a20c-4066-993f-05c7f50a8ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ab51a6-34f7-462d-9488-ecd12921ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:20:55 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 (1eb2a968-bc62-4614-b43b-abf0a4ab3945): created successfully Jul 09 05:20:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ab51a6-34f7-462d-9488-ecd12921ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:20:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (be0b345a-3503-4b68-a242-faa0f405c117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:20:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f8c12ae4-0d72-42ab-bbfa-9eaf01a0b0df tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created volume successfully. Jul 09 05:20:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:20:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:20:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Creating offline snapshot ce4e9367-6c9c-4c88-be4f-66242c0be985 of volume 1eb2a968-bc62-4614-b43b-abf0a4ab3945 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:20:56 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4329ebe-ed14-42fd-bc4e-ed26f7c5679d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:20:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:56 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 Jul 09 05:20:56 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:57 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945" returned: 0 in 0.724s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:57 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 1G Jul 09 05:20:57 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:58 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 1G" returned: 0 in 0.761s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:58 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 Jul 09 05:20:58 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:58 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985" returned: 0 in 0.693s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:58 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 is being set with open permissions: ugo+rw Jul 09 05:20:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:58 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 Jul 09 05:20:58 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:20:59 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 09 05:20:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985" returned: 0 in 0.620s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:20:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:20:59 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.info Jul 09 05:20:59 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:00 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.info" returned: 0 in 0.627s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:00 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.info is being set with open permissions: ugo+rw Jul 09 05:21:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:00 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.info Jul 09 05:21:00 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:00 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.info" returned: 0 in 0.669s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.175s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-661550b1-d3cf-4c8a-8de8-876c6561381e tempest-CreateVolumesFromSnapshotTest-1001139463 None] Create snapshot completed successfully Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (6b45e3b8-8403-4233-8880-58b559bf02dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d699061-6e65-4a30-bc5e-7c31c8c63341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d699061-6e65-4a30-bc5e-7c31c8c63341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-600989462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f562a4-6c7d-4844-a59b-80412324cf14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:02Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465d903c-14f5-4810-89e8-58bf263adc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465d903c-14f5-4810-89e8-58bf263adc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4beec7c4-dbab-4c90-adb0-fa7bf976dcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4beec7c4-dbab-4c90-adb0-fa7bf976dcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f562a4-6c7d-4844-a59b-80412324cf14', 'volume_name': 'volume-03f562a4-6c7d-4844-a59b-80412324cf14', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d87926c-c429-4481-a65c-c2aff74b67dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d87926c-c429-4481-a65c-c2aff74b67dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d388ce-90f7-4a38-bc86-59de5d5b25fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:02 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume 03f562a4-6c7d-4844-a59b-80412324cf14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f562a4-6c7d-4844-a59b-80412324cf14', 'volume_size': 1} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-600989462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f562a4-6c7d-4844-a59b-80412324cf14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:02Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Creating volume 03f562a4-6c7d-4844-a59b-80412324cf14 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:02 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:02 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14 1073741824 Jul 09 05:21:02 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (863d8eb6-9d00-4693-9d33-004bbc9f2255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ff9a42-2ade-4a87-ad68-f5e264fd589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ff9a42-2ade-4a87-ad68-f5e264fd589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-592810173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2792ce41-1b63-4550-ac68-f44c2bbfc18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:03Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd1aa70-136d-4d2c-98f6-198b51dd39fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd1aa70-136d-4d2c-98f6-198b51dd39fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e2a57a-0fa8-4729-9f10-606768fa4a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e2a57a-0fa8-4729-9f10-606768fa4a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2792ce41-1b63-4550-ac68-f44c2bbfc18a', 'volume_name': 'volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5095bf-95ce-4df9-a92e-d538defe259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5095bf-95ce-4df9-a92e-d538defe259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd4cc20-0fef-4356-b7c7-83dee46ceab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:02 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume 2792ce41-1b63-4550-ac68-f44c2bbfc18a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a', 'volume_size': 1} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (849d4aab-b071-4ad9-95a7-dae705230860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef506155-5a26-429d-bdfb-78953842a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef506155-5a26-429d-bdfb-78953842a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877862516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac05bf1-0c54-44ab-88c1-f37b3abf0db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:03Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fff3bc-21a2-4f47-87eb-823863d1c3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fff3bc-21a2-4f47-87eb-823863d1c3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866bfb3b-3a5d-471e-bf87-6208c9aa2b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866bfb3b-3a5d-471e-bf87-6208c9aa2b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac05bf1-0c54-44ab-88c1-f37b3abf0db5', 'volume_name': 'volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20036174-bbd7-4716-8678-053c363caab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20036174-bbd7-4716-8678-053c363caab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875d3413-74db-4648-938e-9a7e9442d786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume fac05bf1-0c54-44ab-88c1-f37b3abf0db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5', 'volume_size': 1} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:03 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14 1073741824" returned: 0 in 0.924s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:03 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14 Jul 09 05:21:03 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (7abe4c13-ba9e-4d14-bc01-46d0a76b125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fe12f4-5c32-4bad-b4ec-5c08155aa5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fe12f4-5c32-4bad-b4ec-5c08155aa5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640302690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b349b7f3-80d4-4060-a33a-63bb46c78803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:03Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c2c988-e2e4-446c-8f72-6722b28dddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c2c988-e2e4-446c-8f72-6722b28dddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f1b21e-fa14-4d9c-8689-bee3a3d99171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f1b21e-fa14-4d9c-8689-bee3a3d99171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b349b7f3-80d4-4060-a33a-63bb46c78803', 'volume_name': 'volume-b349b7f3-80d4-4060-a33a-63bb46c78803', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8186a39-0ab1-420b-b3bf-ebb923007758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8186a39-0ab1-420b-b3bf-ebb923007758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d045c72-0d26-4721-9b8c-4e5cef3e8a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume b349b7f3-80d4-4060-a33a-63bb46c78803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b349b7f3-80d4-4060-a33a-63bb46c78803', 'volume_size': 1} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (6a2fdca9-a326-40c5-a8a5-a28116813197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e965662-421b-4f7d-9164-f7f06824e519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e965662-421b-4f7d-9164-f7f06824e519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1748469441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc04c93-b76f-4a2a-9213-504def82495e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:04Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab7b0f6-d0de-4620-a0ba-037fbce61205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab7b0f6-d0de-4620-a0ba-037fbce61205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833badeb-4e29-41d9-acf5-f6ab7852fc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833badeb-4e29-41d9-acf5-f6ab7852fc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc04c93-b76f-4a2a-9213-504def82495e', 'volume_name': 'volume-9dc04c93-b76f-4a2a-9213-504def82495e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb28e01-0799-476d-8b72-c792bce723c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb28e01-0799-476d-8b72-c792bce723c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81fe120-b1a4-492a-b8f0-e46229c5e57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:03 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume 9dc04c93-b76f-4a2a-9213-504def82495e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc04c93-b76f-4a2a-9213-504def82495e', 'volume_size': 1} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:03 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14" returned: 0 in 0.661s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.237s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-592810173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2792ce41-1b63-4550-ac68-f44c2bbfc18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:03Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Creating volume 2792ce41-1b63-4550-ac68-f44c2bbfc18a {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:03 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d388ce-90f7-4a38-bc86-59de5d5b25fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f562a4-6c7d-4844-a59b-80412324cf14', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:03 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a 1073741824 Jul 09 05:21:03 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32ef6c6-e2e8-445b-be22-d4c67c6cc7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:04 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume volume-03f562a4-6c7d-4844-a59b-80412324cf14 (03f562a4-6c7d-4844-a59b-80412324cf14): created successfully Jul 09 05:21:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32ef6c6-e2e8-445b-be22-d4c67c6cc7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (6b45e3b8-8403-4233-8880-58b559bf02dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4f0239b8-d2ff-43d7-9c4c-d8c7063d9b00 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created volume successfully. Jul 09 05:21:04 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a 1073741824" returned: 0 in 0.808s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:04 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a Jul 09 05:21:04 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:05 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a" returned: 0 in 0.628s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.369s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877862516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac05bf1-0c54-44ab-88c1-f37b3abf0db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:03Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Creating volume fac05bf1-0c54-44ab-88c1-f37b3abf0db5 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:05 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd4cc20-0fef-4356-b7c7-83dee46ceab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:05 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5 1073741824 Jul 09 05:21:05 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7257b9-7a02-435c-ba69-1f6854ab1b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:05 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a (2792ce41-1b63-4550-ac68-f44c2bbfc18a): created successfully Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7257b9-7a02-435c-ba69-1f6854ab1b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (863d8eb6-9d00-4693-9d33-004bbc9f2255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:05 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-161ebce9-7148-46c4-9501-9a013c8ff8d1 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created volume successfully. Jul 09 05:21:06 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5 1073741824" returned: 0 in 0.791s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:06 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5 Jul 09 05:21:06 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:06 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5" returned: 0 in 0.612s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.443s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640302690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b349b7f3-80d4-4060-a33a-63bb46c78803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:03Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Creating volume b349b7f3-80d4-4060-a33a-63bb46c78803 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:06 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:06 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803 1073741824 Jul 09 05:21:06 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875d3413-74db-4648-938e-9a7e9442d786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba875830-b817-4feb-b0be-5af5d9c03f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:06 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5 (fac05bf1-0c54-44ab-88c1-f37b3abf0db5): created successfully Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba875830-b817-4feb-b0be-5af5d9c03f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (849d4aab-b071-4ad9-95a7-dae705230860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:06 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c2493fdb-4993-49c8-b165-b2a024a03d26 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created volume successfully. Jul 09 05:21:07 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803 1073741824" returned: 0 in 0.798s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:07 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803 Jul 09 05:21:07 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:08 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803" returned: 0 in 0.618s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.522s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1748469441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc04c93-b76f-4a2a-9213-504def82495e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e41687befd44d17a75de87fcc6f95af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:04Z,use_quota=True,user_id='2b07b3cd31c843a2a9ce67fa4f571c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Creating volume 9dc04c93-b76f-4a2a-9213-504def82495e {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:08 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d045c72-0d26-4721-9b8c-4e5cef3e8a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b349b7f3-80d4-4060-a33a-63bb46c78803', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d250fd3-7a35-487f-9911-57312ca32236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:08 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e 1073741824 Jul 09 05:21:08 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:08 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume volume-b349b7f3-80d4-4060-a33a-63bb46c78803 (b349b7f3-80d4-4060-a33a-63bb46c78803): created successfully Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d250fd3-7a35-487f-9911-57312ca32236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (7abe4c13-ba9e-4d14-bc01-46d0a76b125d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:08 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1dc77cc6-4efc-40a0-a872-0a2721fd3798 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created volume successfully. Jul 09 05:21:09 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e 1073741824" returned: 0 in 0.818s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:09 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e Jul 09 05:21:09 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:09 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e" returned: 0 in 0.660s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81fe120-b1a4-492a-b8f0-e46229c5e57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc04c93-b76f-4a2a-9213-504def82495e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696fb288-de3a-45c5-ab1b-dbc527c09850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:09 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Volume volume-9dc04c93-b76f-4a2a-9213-504def82495e (9dc04c93-b76f-4a2a-9213-504def82495e): created successfully Jul 09 05:21:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696fb288-de3a-45c5-ab1b-dbc527c09850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Flow 'volume_create_manager' (6a2fdca9-a326-40c5-a8a5-a28116813197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b6f3b604-f755-4c06-92d3-18d918d8663f tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created volume successfully. Jul 09 05:21:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-9dc04c93-b76f-4a2a-9213-504def82495e-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-9dc04c93-b76f-4a2a-9213-504def82495e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-quobyte-9dc04c93-b76f-4a2a-9213-504def82495e" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-9dc04c93-b76f-4a2a-9213-504def82495e" acquired by "delete_volume" :: waited 0.013s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:10 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[508567df-9c3b-4865-a61d-1d7444704956]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:10 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e Jul 09 05:21:10 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:11 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e" returned: 0 in 0.756s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:11 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e Jul 09 05:21:11 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:11 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9dc04c93-b76f-4a2a-9213-504def82495e" returned: 0 in 0.623s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-9dc04c93-b76f-4a2a-9213-504def82495e" released by "delete_volume" :: held 1.414s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created reservations ['a919b792-7b47-4c37-84f5-0fe39c4b6b79', '198d4e28-c5af-4c64-a5aa-c4e32dd47eca', '3fa8bd1c-1896-47dd-9c0a-6e2d189a1c4a', '218adad8-9fc7-41e6-ad30-08330cfa7848'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:11 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:11 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-b349b7f3-80d4-4060-a33a-63bb46c78803-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-b349b7f3-80d4-4060-a33a-63bb46c78803-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:12 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.644s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:12 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:12 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Deleted volume successfully. Jul 09 05:21:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9b13e227-1506-4e94-9def-3585a9a73d74 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-9dc04c93-b76f-4a2a-9213-504def82495e-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-quobyte-b349b7f3-80d4-4060-a33a-63bb46c78803" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-b349b7f3-80d4-4060-a33a-63bb46c78803" acquired by "delete_volume" :: waited 0.012s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54fb0d4-e37a-4a7f-b2ba-59a6be02c8f9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:12 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803 Jul 09 05:21:12 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:13 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803" returned: 0 in 0.716s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:13 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803 Jul 09 05:21:13 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:13 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b349b7f3-80d4-4060-a33a-63bb46c78803" returned: 0 in 0.613s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-b349b7f3-80d4-4060-a33a-63bb46c78803" released by "delete_volume" :: held 1.366s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created reservations ['d6d93430-58c2-4c35-b149-2727ec4861e5', '7bd01b56-5683-4094-a46f-4be069bf0ca7', '03954862-151e-40c0-8bac-a58beba49a77', '3280a85e-2b3f-4e06-bc76-5c369ae3c35e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:14 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:14 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:14 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.609s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:14 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:14 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Deleted volume successfully. Jul 09 05:21:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-54e9f2ce-78cc-4298-bda0-aad4d2b6f5e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-b349b7f3-80d4-4060-a33a-63bb46c78803-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-fac05bf1-0c54-44ab-88c1-f37b3abf0db5-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-fac05bf1-0c54-44ab-88c1-f37b3abf0db5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-quobyte-fac05bf1-0c54-44ab-88c1-f37b3abf0db5" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-fac05bf1-0c54-44ab-88c1-f37b3abf0db5" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:14 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70a2995-85b0-4524-a72e-f7763437c397]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:14 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5 Jul 09 05:21:14 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:15 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5" returned: 0 in 0.717s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:15 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5 Jul 09 05:21:15 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:16 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fac05bf1-0c54-44ab-88c1-f37b3abf0db5" returned: 0 in 0.623s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-fac05bf1-0c54-44ab-88c1-f37b3abf0db5" released by "delete_volume" :: held 1.381s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created reservations ['846f9ab3-be41-437f-a7b7-1176566f6e0a', '12002ff3-e823-44ad-aa96-c66bd7c83113', 'b66a23ad-0a74-4a23-8ea8-2c74ca649a21', '55745504-ef85-4061-ad1f-8c20cc0a08ea'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:16 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:16 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:16 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.643s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Deleted volume successfully. Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-2792ce41-1b63-4550-ac68-f44c2bbfc18a-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-2792ce41-1b63-4550-ac68-f44c2bbfc18a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4261c443-5284-4063-9fce-02d4786b2cfc tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-fac05bf1-0c54-44ab-88c1-f37b3abf0db5-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-quobyte-2792ce41-1b63-4550-ac68-f44c2bbfc18a" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-2792ce41-1b63-4550-ac68-f44c2bbfc18a" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e56b434-dbe0-494f-839b-4493a0d1bc4b]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:17 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a Jul 09 05:21:17 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:17 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a" returned: 0 in 0.721s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:17 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a Jul 09 05:21:17 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:18 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2792ce41-1b63-4550-ac68-f44c2bbfc18a" returned: 0 in 0.620s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-2792ce41-1b63-4550-ac68-f44c2bbfc18a" released by "delete_volume" :: held 1.379s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:18 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created reservations ['8890b35c-4953-4e21-90b7-53610dc04b75', 'a51edf4d-a536-4034-a015-da32bf9bc2a3', '4f4363b3-5c68-4d72-a255-916cbb722bb6', '74040f41-6334-467b-bfa4-b619def2f606'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:18 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:18 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:19 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.624s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Deleted volume successfully. Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-14fdd7e7-545a-4440-bfcc-7f2513f9038b tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-2792ce41-1b63-4550-ac68-f44c2bbfc18a-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-03f562a4-6c7d-4844-a59b-80412324cf14-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-03f562a4-6c7d-4844-a59b-80412324cf14-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-quobyte-03f562a4-6c7d-4844-a59b-80412324cf14" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-03f562a4-6c7d-4844-a59b-80412324cf14" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3d739a-905c-4f4b-bef4-764fddf619fe]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:19 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14 Jul 09 05:21:19 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:19 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14" returned: 0 in 0.719s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:19 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14 Jul 09 05:21:19 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:20 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-03f562a4-6c7d-4844-a59b-80412324cf14" returned: 0 in 0.617s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-03f562a4-6c7d-4844-a59b-80412324cf14" released by "delete_volume" :: held 1.373s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:20 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created reservations ['37cf747c-21f7-447f-8442-468b823f740a', '15d9e8b2-19f2-4f6e-a034-99f20b5ce366', '92db5a25-16ce-4757-a428-698202766aa3', '062afef6-f360-4bda-bdfe-52befb8af992'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:20 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:20 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:21 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.621s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Deleted volume successfully. Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-ce4e9367-6c9c-4c88-be4f-66242c0be985-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f9343014-d3e7-44f1-9cde-889161aea0e9 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-03f562a4-6c7d-4844-a59b-80412324cf14-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-ce4e9367-6c9c-4c88-be4f-66242c0be985-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-quobyte-1eb2a968-bc62-4614-b43b-abf0a4ab3945" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-1eb2a968-bc62-4614-b43b-abf0a4ab3945" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-quobyte-ce4e9367-6c9c-4c88-be4f-66242c0be985" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-ce4e9367-6c9c-4c88-be4f-66242c0be985" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Deleting offline snapshot ce4e9367-6c9c-4c88-be4f-66242c0be985 of volume 1eb2a968-bc62-4614-b43b-abf0a4ab3945 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] snapshot_file for this snap is: volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab689b53-a62d-4548-a544-e79aaa3404c8]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:21 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 Jul 09 05:21:21 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:22 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985" returned: 0 in 0.733s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:21:22 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ac50e7-db08-410b-b1fa-42ad0b61e707]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:22 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 Jul 09 05:21:22 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:23 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945" returned: 0 in 0.824s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:23 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 Jul 09 05:21:23 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:23 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985" returned: 0 in 0.710s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:23 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985 Jul 09 05:21:23 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:24 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945.ce4e9367-6c9c-4c88-be4f-66242c0be985" returned: 0 in 0.745s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-ce4e9367-6c9c-4c88-be4f-66242c0be985" released by "_delete_snapshot" :: held 3.117s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-1eb2a968-bc62-4614-b43b-abf0a4ab3945" released by "delete_snapshot" :: held 3.139s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:24 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created reservations ['2e5bcb29-7f62-4c48-b81f-9cbe539d3cc6', '0fb6279b-53d7-42f9-9899-e538ae18bcd7', 'b0000fc7-f543-451e-af2a-f5ddf55cac18', '42730c1e-e899-4d8a-8bd1-b3c57ad6c597'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:24 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Delete snapshot completed successfully. Jul 09 05:21:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-25fddd24-24a6-49f9-bf6d-9394c3a7b352 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-ce4e9367-6c9c-4c88-be4f-66242c0be985-delete_snapshot" released by "delete_snapshot" :: held 3.273s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-1eb2a968-bc62-4614-b43b-abf0a4ab3945-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-1eb2a968-bc62-4614-b43b-abf0a4ab3945-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "cinder-quobyte-1eb2a968-bc62-4614-b43b-abf0a4ab3945" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-1eb2a968-bc62-4614-b43b-abf0a4ab3945" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:25 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fb4dad-75fa-4b69-aa55-57fa1cd60e56]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:25 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 Jul 09 05:21:25 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:26 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945" returned: 0 in 0.761s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:26 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945 Jul 09 05:21:26 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:27 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1eb2a968-bc62-4614-b43b-abf0a4ab3945" returned: 0 in 0.619s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-quobyte-1eb2a968-bc62-4614-b43b-abf0a4ab3945" released by "delete_volume" :: held 1.433s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Created reservations ['286d2f4d-945e-464e-82a4-785dcc1292c0', '98293908-8402-4bb9-9b8f-ee9a01e89b11', 'cb2a5aa5-5c60-4bae-9923-a2e4a33eda44', 'd52cf84c-4d0f-45b9-bb04-f7d9ee8a47aa'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:27 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:27 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:27 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.625s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:27 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Deleted volume successfully. Jul 09 05:21:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d5a990e1-675a-41a0-ab0d-b1eb3ceb85e7 tempest-CreateVolumesFromSnapshotTest-1001139463 None] Lock "cinder-1eb2a968-bc62-4614-b43b-abf0a4ab3945-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (5fad8c15-6dfe-4205-ba7a-36b622e36412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0ce539-d2e8-4020-b91e-f34bf5961ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0ce539-d2e8-4020-b91e-f34bf5961ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1266899658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2badd672-19c7-4abc-8e48-27b7816bb35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:30Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c37c26-5658-4ebd-962b-ca52a02f8543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c37c26-5658-4ebd-962b-ca52a02f8543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b50324-692e-4ca6-81d6-797569133928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b50324-692e-4ca6-81d6-797569133928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2badd672-19c7-4abc-8e48-27b7816bb35a', 'volume_name': 'volume-2badd672-19c7-4abc-8e48-27b7816bb35a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e0c133-d77b-43f8-b5b1-d0c991876dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e0c133-d77b-43f8-b5b1-d0c991876dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0490e4ff-6f12-4f89-96cd-f3b72304f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:30 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume 2badd672-19c7-4abc-8e48-27b7816bb35a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2badd672-19c7-4abc-8e48-27b7816bb35a', 'volume_size': 1} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1266899658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2badd672-19c7-4abc-8e48-27b7816bb35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:30Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Creating volume 2badd672-19c7-4abc-8e48-27b7816bb35a {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:30 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:30 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a 1073741824 Jul 09 05:21:30 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:31 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a 1073741824" returned: 0 in 0.791s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:31 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a Jul 09 05:21:31 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:31 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a" returned: 0 in 0.623s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0490e4ff-6f12-4f89-96cd-f3b72304f013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2badd672-19c7-4abc-8e48-27b7816bb35a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9405912-ec81-4f85-a679-d79e0fbfd116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:31 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume volume-2badd672-19c7-4abc-8e48-27b7816bb35a (2badd672-19c7-4abc-8e48-27b7816bb35a): created successfully Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9405912-ec81-4f85-a679-d79e0fbfd116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (5fad8c15-6dfe-4205-ba7a-36b622e36412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:32 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5584b061-0de8-476b-84e5-62629769d215 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created volume successfully. Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=63,cinder:INSERT=25,cinder:UPDATE=86,cinder:DELETE=4 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=93,cinder:SELECT=71,cinder:INSERT=26,cinder:DELETE=12 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (e65e1490-b30d-4bbe-a7ef-1ca63b5a62ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd55a76-5162-43ee-a6ac-f4f2328d7b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd55a76-5162-43ee-a6ac-f4f2328d7b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441637184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe33d66-c8f4-492e-af88-ae9c1daaea5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:33Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27d3aaa-6a6b-4d4e-904c-8e008fc956e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27d3aaa-6a6b-4d4e-904c-8e008fc956e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c4b546-e986-4cd2-92ad-f727d793dd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c4b546-e986-4cd2-92ad-f727d793dd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe33d66-c8f4-492e-af88-ae9c1daaea5d', 'volume_name': 'volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15238b51-b85e-4eb1-84f3-9bc19e21e3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15238b51-b85e-4eb1-84f3-9bc19e21e3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8287ff-027c-4b52-bbbf-f2d239c6c9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:32 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume 8fe33d66-c8f4-492e-af88-ae9c1daaea5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d', 'volume_size': 1} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441637184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe33d66-c8f4-492e-af88-ae9c1daaea5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:33Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Creating volume 8fe33d66-c8f4-492e-af88-ae9c1daaea5d {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:32 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:33 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d 1073741824 Jul 09 05:21:33 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (c41f7ca3-9f34-47e2-826b-ca5ea80c6bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d003868-0c41-490e-b152-1059f4b4f772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d003868-0c41-490e-b152-1059f4b4f772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2074342382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a0f36a-8d00-4706-be17-50e4ca104a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:33Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df58889-6313-4d35-8dce-8a0febc01381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df58889-6313-4d35-8dce-8a0febc01381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f0d02-4c40-4d1f-9e27-757e5ab1cad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f0d02-4c40-4d1f-9e27-757e5ab1cad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a0f36a-8d00-4706-be17-50e4ca104a39', 'volume_name': 'volume-e9a0f36a-8d00-4706-be17-50e4ca104a39', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ef1a36-f376-4c7b-be46-69b75659e453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ef1a36-f376-4c7b-be46-69b75659e453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa52c0d-ce75-4a4e-87f6-84df93805f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:33 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume e9a0f36a-8d00-4706-be17-50e4ca104a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a0f36a-8d00-4706-be17-50e4ca104a39', 'volume_size': 1} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (8570642f-9567-4c48-80e8-dd24de3421fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070d848f-c6fd-44fa-a2c2-aba0647dd3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070d848f-c6fd-44fa-a2c2-aba0647dd3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881032291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d63bab-a756-49c7-9318-fcd6b58c7c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:34Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca45131-9077-4561-a830-e2e2a4b5d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca45131-9077-4561-a830-e2e2a4b5d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5d257b-838f-43c2-b8f7-9023ed566f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5d257b-838f-43c2-b8f7-9023ed566f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d63bab-a756-49c7-9318-fcd6b58c7c32', 'volume_name': 'volume-90d63bab-a756-49c7-9318-fcd6b58c7c32', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b8d7e6-2123-4761-85c8-07203347bb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b8d7e6-2123-4761-85c8-07203347bb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880d9e4d-3af5-4a18-ba14-1f2fd935554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:33 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume 90d63bab-a756-49c7-9318-fcd6b58c7c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d63bab-a756-49c7-9318-fcd6b58c7c32', 'volume_size': 1} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:33 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d 1073741824" returned: 0 in 0.925s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:33 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d Jul 09 05:21:33 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:33 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (7ebc4c89-7342-4cbe-a5b4-ffdc3330075c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2899935-614c-46c3-b2af-9565266ccad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2899935-614c-46c3-b2af-9565266ccad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-196051664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a74c88-e93e-490d-be0b-9291ab09767c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:34Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326f649f-fd25-40d4-8f54-e2739ad9eee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326f649f-fd25-40d4-8f54-e2739ad9eee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60f662f-5534-4240-9c86-a1b9a1d5d9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60f662f-5534-4240-9c86-a1b9a1d5d9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a74c88-e93e-490d-be0b-9291ab09767c', 'volume_name': 'volume-68a74c88-e93e-490d-be0b-9291ab09767c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd619cd-3da7-4bff-9ca1-031ab0fefe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd619cd-3da7-4bff-9ca1-031ab0fefe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2a22c1-6a8f-405f-beb9-9dbda3d3c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume 68a74c88-e93e-490d-be0b-9291ab09767c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a74c88-e93e-490d-be0b-9291ab09767c', 'volume_size': 1} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (81089c2e-c4ef-4895-81f2-83b7155ae66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0fb0db-9bc9-476c-97d1-458d7a2f5457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0fb0db-9bc9-476c-97d1-458d7a2f5457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029025077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9af0cd-19d7-433b-a992-79791fbdc087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:34Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861c2fcc-f4e7-4cde-9593-4b7c8130efc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861c2fcc-f4e7-4cde-9593-4b7c8130efc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a0e45e-632c-4937-9713-032695d13706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a0e45e-632c-4937-9713-032695d13706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f9af0cd-19d7-433b-a992-79791fbdc087', 'volume_name': 'volume-2f9af0cd-19d7-433b-a992-79791fbdc087', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f1335e-8fce-4b09-9b03-eb5bac41a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f1335e-8fce-4b09-9b03-eb5bac41a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4f0e72-787e-4944-af20-aff26178fcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume 2f9af0cd-19d7-433b-a992-79791fbdc087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f9af0cd-19d7-433b-a992-79791fbdc087', 'volume_size': 1} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:34 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d" returned: 0 in 0.701s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2074342382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a0f36a-8d00-4706-be17-50e4ca104a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:33Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Creating volume e9a0f36a-8d00-4706-be17-50e4ca104a39 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:34 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:34 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39 1073741824 Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8287ff-027c-4b52-bbbf-f2d239c6c9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:34 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbcc7c1-9bb7-4c8d-9aa4-f0f8d9d2cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d (8fe33d66-c8f4-492e-af88-ae9c1daaea5d): created successfully Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbcc7c1-9bb7-4c8d-9aa4-f0f8d9d2cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (e65e1490-b30d-4bbe-a7ef-1ca63b5a62ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:34 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c9e45b1c-2e6b-4253-9083-ae143fbbcabd tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created volume successfully. Jul 09 05:21:35 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39 1073741824" returned: 0 in 0.817s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:35 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39 Jul 09 05:21:35 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:36 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39" returned: 0 in 0.626s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.431s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881032291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d63bab-a756-49c7-9318-fcd6b58c7c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:34Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Creating volume 90d63bab-a756-49c7-9318-fcd6b58c7c32 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:36 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa52c0d-ce75-4a4e-87f6-84df93805f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a0f36a-8d00-4706-be17-50e4ca104a39', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:36 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32 1073741824 Jul 09 05:21:36 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995039da-816e-4eae-8c33-f42221260edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:36 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume volume-e9a0f36a-8d00-4706-be17-50e4ca104a39 (e9a0f36a-8d00-4706-be17-50e4ca104a39): created successfully Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995039da-816e-4eae-8c33-f42221260edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (c41f7ca3-9f34-47e2-826b-ca5ea80c6bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:36 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8e6fd596-6628-47d0-872f-95d3695066b0 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created volume successfully. Jul 09 05:21:36 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32 1073741824" returned: 0 in 0.816s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:37 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32 Jul 09 05:21:37 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:37 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32" returned: 0 in 0.620s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.533s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-196051664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a74c88-e93e-490d-be0b-9291ab09767c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:34Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Creating volume 68a74c88-e93e-490d-be0b-9291ab09767c {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:37 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:37 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c 1073741824 Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880d9e4d-3af5-4a18-ba14-1f2fd935554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d63bab-a756-49c7-9318-fcd6b58c7c32', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:37 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f4cbee-2f52-4ce7-af26-5cc17efe4177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:37 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume volume-90d63bab-a756-49c7-9318-fcd6b58c7c32 (90d63bab-a756-49c7-9318-fcd6b58c7c32): created successfully Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f4cbee-2f52-4ce7-af26-5cc17efe4177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (8570642f-9567-4c48-80e8-dd24de3421fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:37 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-41360d97-0422-4fd5-aee9-9d250d6ba1ae tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created volume successfully. Jul 09 05:21:38 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c 1073741824" returned: 0 in 0.767s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:38 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c Jul 09 05:21:38 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:39 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c" returned: 0 in 0.634s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.661s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029025077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9af0cd-19d7-433b-a992-79791fbdc087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cd6a7bf06c4086b992211773b842e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:34Z,use_quota=True,user_id='fda6585bb75c416d93344fa13fec217b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Creating volume 2f9af0cd-19d7-433b-a992-79791fbdc087 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:21:39 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:39 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087 1073741824 Jul 09 05:21:39 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2a22c1-6a8f-405f-beb9-9dbda3d3c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a74c88-e93e-490d-be0b-9291ab09767c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99635716-598c-475c-a087-c4a48b67ec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:39 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:39 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:39 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume volume-68a74c88-e93e-490d-be0b-9291ab09767c (68a74c88-e93e-490d-be0b-9291ab09767c): created successfully Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99635716-598c-475c-a087-c4a48b67ec9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (7ebc4c89-7342-4cbe-a5b4-ffdc3330075c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:39 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-048db156-0a83-4e2d-91b0-79171288ec9e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created volume successfully. Jul 09 05:21:39 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.656s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:21:39 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087 1073741824" returned: 0 in 0.816s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:39 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087 Jul 09 05:21:39 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:40 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087" returned: 0 in 0.615s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4f0e72-787e-4944-af20-aff26178fcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f9af0cd-19d7-433b-a992-79791fbdc087', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5128efca-2688-475b-9802-edbdd1eb0d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:40 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Volume volume-2f9af0cd-19d7-433b-a992-79791fbdc087 (2f9af0cd-19d7-433b-a992-79791fbdc087): created successfully Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5128efca-2688-475b-9802-edbdd1eb0d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Flow 'volume_create_manager' (81089c2e-c4ef-4895-81f2-83b7155ae66f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:40 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-2245c5c7-c2ae-4bd4-9109-e842665fd3bf tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created volume successfully. Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-2f9af0cd-19d7-433b-a992-79791fbdc087-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-2f9af0cd-19d7-433b-a992-79791fbdc087-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-quobyte-2f9af0cd-19d7-433b-a992-79791fbdc087" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-2f9af0cd-19d7-433b-a992-79791fbdc087" acquired by "delete_volume" :: waited 0.013s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:41 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b24d8a-d21e-430d-9a66-c17bb579ebdc]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:41 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087 Jul 09 05:21:41 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:41 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087" returned: 0 in 0.730s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:41 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087 Jul 09 05:21:41 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:42 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2f9af0cd-19d7-433b-a992-79791fbdc087" returned: 0 in 0.616s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-2f9af0cd-19d7-433b-a992-79791fbdc087" released by "delete_volume" :: held 1.384s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:42 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created reservations ['e29a3dd0-8c82-4a05-9a92-033029caf777', '4c69118a-3457-4511-8fb2-b89a0791584b', '88561c1e-8c58-4105-9cf9-1e01283bcffe', '3060ea0b-eb35-43fd-9cae-b9f880a4034a'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:42 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:42 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-68a74c88-e93e-490d-be0b-9291ab09767c-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-68a74c88-e93e-490d-be0b-9291ab09767c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-quobyte-68a74c88-e93e-490d-be0b-9291ab09767c" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-68a74c88-e93e-490d-be0b-9291ab09767c" acquired by "delete_volume" :: waited 0.013s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:43 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.698s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f710b716-cc14-4734-89eb-52172a52d9fc]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:43 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Deleted volume successfully. Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6ef57661-6c96-42e7-89b1-a4d535186ffa tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-2f9af0cd-19d7-433b-a992-79791fbdc087-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:43 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c Jul 09 05:21:43 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:43 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c" returned: 0 in 0.725s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:43 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c Jul 09 05:21:43 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:44 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-68a74c88-e93e-490d-be0b-9291ab09767c" returned: 0 in 0.615s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-68a74c88-e93e-490d-be0b-9291ab09767c" released by "delete_volume" :: held 1.374s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:44 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created reservations ['77f8da01-1335-4d81-be09-cea95bf6ae5c', 'f03ee3f3-522a-4ea2-843e-69ff8dfd238a', 'aaac1dcf-4df9-470e-a008-c0b0ad8c43b3', '621dea5a-f6ab-4a83-975f-6773db071817'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:44 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:44 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:45 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.616s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:45 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:45 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Deleted volume successfully. Jul 09 05:21:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7e62a29c-80e1-4acf-b3b3-1b183c1e0f5e tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-68a74c88-e93e-490d-be0b-9291ab09767c-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-90d63bab-a756-49c7-9318-fcd6b58c7c32-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-90d63bab-a756-49c7-9318-fcd6b58c7c32-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-quobyte-90d63bab-a756-49c7-9318-fcd6b58c7c32" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-90d63bab-a756-49c7-9318-fcd6b58c7c32" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[282bdac0-2f87-4895-a59f-36b519d8b64d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:45 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32 Jul 09 05:21:45 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:46 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32" returned: 0 in 0.726s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:46 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32 Jul 09 05:21:46 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:46 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-90d63bab-a756-49c7-9318-fcd6b58c7c32" returned: 0 in 0.630s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-90d63bab-a756-49c7-9318-fcd6b58c7c32" released by "delete_volume" :: held 1.390s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created reservations ['5dedc03a-a208-460c-b385-148a49dda41a', '7e300420-49ff-4cbc-83c7-9f1aff0e125a', '1f7ccf4b-bbd5-45de-8369-07fb08c5c4c3', '4bca4bc8-0345-4c18-8ea0-b12fa69a2536'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:46 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:46 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-e9a0f36a-8d00-4706-be17-50e4ca104a39-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-e9a0f36a-8d00-4706-be17-50e4ca104a39-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:47 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.666s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:47 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:47 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Deleted volume successfully. Jul 09 05:21:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-quobyte-e9a0f36a-8d00-4706-be17-50e4ca104a39" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3a72a80b-f77d-4cbe-b6dd-244dba88a361 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-90d63bab-a756-49c7-9318-fcd6b58c7c32-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-e9a0f36a-8d00-4706-be17-50e4ca104a39" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:47 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cb9ca2-de27-4875-ac6c-dc5c727d75af]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:47 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39 Jul 09 05:21:47 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:48 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39" returned: 0 in 0.726s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:48 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39 Jul 09 05:21:48 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:48 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e9a0f36a-8d00-4706-be17-50e4ca104a39" returned: 0 in 0.625s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-e9a0f36a-8d00-4706-be17-50e4ca104a39" released by "delete_volume" :: held 1.387s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created reservations ['c844a817-b1ef-4571-bf11-724feb14baff', '8d90cb27-f371-417d-aa3f-d2f0d28c6a55', '4d01889b-f01e-4a58-97fd-bb0ca06d0685', '8602cb43-4e25-4c93-a7cb-5cc4e2fe1a57'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:49 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:49 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:49 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.620s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:49 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Deleted volume successfully. Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-8fe33d66-c8f4-492e-af88-ae9c1daaea5d-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-41556293-3872-4f9d-a7a7-37edebc2587d tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-e9a0f36a-8d00-4706-be17-50e4ca104a39-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-8fe33d66-c8f4-492e-af88-ae9c1daaea5d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-quobyte-8fe33d66-c8f4-492e-af88-ae9c1daaea5d" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-8fe33d66-c8f4-492e-af88-ae9c1daaea5d" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd28b5b-4203-45a5-8b75-e4f92eb648fd]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:49 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d Jul 09 05:21:49 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:50 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d" returned: 0 in 0.735s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:50 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d Jul 09 05:21:50 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:51 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8fe33d66-c8f4-492e-af88-ae9c1daaea5d" returned: 0 in 0.619s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-8fe33d66-c8f4-492e-af88-ae9c1daaea5d" released by "delete_volume" :: held 1.390s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created reservations ['552b5ceb-9355-4e21-83c6-4a273370bce5', '20965b44-bccb-475b-a536-ad82492caf40', '204ca445-88c5-48ef-b9c3-9bddf7273354', 'd9da8ac7-ffd8-4afb-ba2d-2e0791cb6005'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:51 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:51 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:51 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.623s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Deleted volume successfully. Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-3c3b0bf9-17ee-4494-a667-65e7a50b9021 tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-8fe33d66-c8f4-492e-af88-ae9c1daaea5d-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-2badd672-19c7-4abc-8e48-27b7816bb35a-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-2badd672-19c7-4abc-8e48-27b7816bb35a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "cinder-quobyte-2badd672-19c7-4abc-8e48-27b7816bb35a" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:21:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-2badd672-19c7-4abc-8e48-27b7816bb35a" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:21:52 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74f0b31-bf9a-45bf-883b-1c1daf340d6e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:52 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a Jul 09 05:21:52 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:52 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a" returned: 0 in 0.727s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:52 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a Jul 09 05:21:52 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:53 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2badd672-19c7-4abc-8e48-27b7816bb35a" returned: 0 in 0.637s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-quobyte-2badd672-19c7-4abc-8e48-27b7816bb35a" released by "delete_volume" :: held 1.398s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:53 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Created reservations ['97db13a3-6475-4007-9288-5b91d95a1670', '7e9dcfa5-f5ac-4771-adeb-f53b31cf52b7', '5cd665ca-77cd-4881-afad-f762c4279da2', '96350dec-7d40-4bb1-a4eb-fece49caffd5'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:21:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:21:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:21:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:21:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:21:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:21:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:53 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:21:53 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:54 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.624s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:54 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:21:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Deleted volume successfully. Jul 09 05:21:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-131d44cf-717c-42cb-803b-141c7abf9e4c tempest-CreateVolumesFromSourceVolumeTest-1296507449 None] Lock "cinder-2badd672-19c7-4abc-8e48-27b7816bb35a-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:21:58 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:21:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Flow 'volume_create_manager' (c990be8c-f334-47ed-8000-6b3844861dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:21:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116f69e2-78dd-4f8d-8b8a-c753a47e0c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116f69e2-78dd-4f8d-8b8a-c753a47e0c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e84b6b-36a7-4aa4-bee2-cc8715f312c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d581ba291c2b439481b000e3c161ff62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:59Z,use_quota=True,user_id='50919017295e4d15aaa26261dca3b86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935c71bc-aaa4-43c5-9a88-77e51578299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935c71bc-aaa4-43c5-9a88-77e51578299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:58 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37d2204-47a4-405b-9e77-09a48322048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:58 devstack cinder-volume[87161]: DEBUG cinder.image.glance [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Creating Keystone auth plugin from conf {{(pid=87161) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 05:21:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37d2204-47a4-405b-9e77-09a48322048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35e84b6b-36a7-4aa4-bee2-cc8715f312c2', 'volume_name': 'volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2', 'volume_size': 1, 'image_id': '7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3dadd959d68e1a394a27276dac02678d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd581ba291c2b439481b000e3c161ff62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '255358f22f1d5d70d8e005afca7264b746ecd87f6d91b7630bc0f00115c1840daefef5e82d7ec06e9266d64d8716e80953ea66e56fe260694a13d2e4b72835ac', 'id': '7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'created_at': datetime.datetime(2026, 7, 9, 3, 21, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4/file', 'properties': {}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca203c5b-bdfb-4aba-9b39-cfe3655fb0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca203c5b-bdfb-4aba-9b39-cfe3655fb0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:21:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57118f4f-e539-4242-b774-5cff813f2b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:21:59 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Volume 35e84b6b-36a7-4aa4-bee2-cc8715f312c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2', 'volume_size': 1, 'image_id': '7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3dadd959d68e1a394a27276dac02678d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd581ba291c2b439481b000e3c161ff62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '255358f22f1d5d70d8e005afca7264b746ecd87f6d91b7630bc0f00115c1840daefef5e82d7ec06e9266d64d8716e80953ea66e56fe260694a13d2e4b72835ac', 'id': '7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'created_at': datetime.datetime(2026, 7, 9, 3, 21, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4/file', 'properties': {}}, 'image_service': } Jul 09 05:21:59 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Trying to clone 35e84b6b-36a7-4aa4-bee2-cc8715f312c2 from image 7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'metadata': {}}]). {{(pid=87161) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 05:21:59 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 05:21:59 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Image download 0.00 MB at 0.00 MB/s Jul 09 05:21:59 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2359e401-f5af-432a-ab7f-fa7533bc4873]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:21:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:21:59 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD Jul 09 05:21:59 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:21:59 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 09 05:21:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD" returned: 0 in 0.697s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:21:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:00 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD Jul 09 05:22:00 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:00 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD" returned: 1 in 0.694s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:00 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Temporary image 7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4 is fetched for user 50919017295e4d15aaa26261dca3b86a. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 05:22:00 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1221eef5-8f05-4eef-ac3e-e50bed233e09]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:00 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD Jul 09 05:22:00 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:01 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:01 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD Jul 09 05:22:01 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:02 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD" returned: 1 in 0.724s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e84b6b-36a7-4aa4-bee2-cc8715f312c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d581ba291c2b439481b000e3c161ff62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:21:59Z,use_quota=True,user_id='50919017295e4d15aaa26261dca3b86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Creating volume 35e84b6b-36a7-4aa4-bee2-cc8715f312c2 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:02 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:02 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 1073741824 Jul 09 05:22:02 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:02 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 1073741824" returned: 0 in 0.799s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:02 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 Jul 09 05:22:02 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:03 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2" returned: 0 in 0.647s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:22:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:03 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Attempting download of 7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'metadata': {}}])) to volume 35e84b6b-36a7-4aa4-bee2-cc8715f312c2. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 05:22:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[660b5291-9482-46a9-93a5-cc5aa0e6320a]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_tiltvef0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:03 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_tiltvef0 Jul 09 05:22:03 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:04 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_tiltvef0" returned: 0 in 0.711s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_tiltvef0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:04 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_tiltvef0 Jul 09 05:22:04 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:05 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_tiltvef0" returned: 1 in 0.705s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_tiltvef0' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:05 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe1151f-f329-4b47-a232-b3c3687da392]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:05 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD Jul 09 05:22:05 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:05 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD" returned: 0 in 0.700s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:05 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD Jul 09 05:22:05 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:06 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD" returned: 1 in 0.680s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:06 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] 7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4 was raw, converting to raw {{(pid=87161) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 05:22:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:06 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 Jul 09 05:22:06 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:07 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2" returned: 0 in 0.686s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:07 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4_440oejugdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:22:07 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 05:22:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:07 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 1G Jul 09 05:22:07 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:07 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 1G" returned: 0 in 0.647s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:07 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dba24e-9f93-475e-a0d1-5fa355ba42ed]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:07 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 Jul 09 05:22:07 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:08 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2" returned: 0 in 0.712s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:08 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 Jul 09 05:22:08 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:09 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2" returned: 1 in 0.733s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Downloaded image 7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'metadata': {}}])) to volume 35e84b6b-36a7-4aa4-bee2-cc8715f312c2 successfully. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Temporary image 7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4 for user 50919017295e4d15aaa26261dca3b86a is deleted. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Marking volume 35e84b6b-36a7-4aa4-bee2-cc8715f312c2 as bootable. {{(pid=87161) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Copying metadata from image 7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4 to 35e84b6b-36a7-4aa4-bee2-cc8715f312c2. {{(pid=87161) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Creating volume glance metadata for volume 35e84b6b-36a7-4aa4-bee2-cc8715f312c2 backed by image 7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4 with: {'image_id': '7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3dadd959d68e1a394a27276dac02678d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87161) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57118f4f-e539-4242-b774-5cff813f2b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2', 'volume_size': 1, 'image_id': '7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3dadd959d68e1a394a27276dac02678d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd581ba291c2b439481b000e3c161ff62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '255358f22f1d5d70d8e005afca7264b746ecd87f6d91b7630bc0f00115c1840daefef5e82d7ec06e9266d64d8716e80953ea66e56fe260694a13d2e4b72835ac', 'id': '7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4', 'created_at': datetime.datetime(2026, 7, 9, 3, 21, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c7bec17-dfc9-49c3-a49f-35c6fd3e8bb4/file', 'properties': {}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbba08c0-7a7f-4632-aa2c-9a7368c5abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:09 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Volume volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 (35e84b6b-36a7-4aa4-bee2-cc8715f312c2): created successfully Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbba08c0-7a7f-4632-aa2c-9a7368c5abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Flow 'volume_create_manager' (c990be8c-f334-47ed-8000-6b3844861dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-2fe62f3b-8cc7-46c6-a348-526b679d1d3e tempest-VolumeImageDependencyTests-2052595322 None] Created volume successfully. Jul 09 05:22:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Acquiring lock "cinder-35e84b6b-36a7-4aa4-bee2-cc8715f312c2-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Lock "cinder-35e84b6b-36a7-4aa4-bee2-cc8715f312c2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Acquiring lock "cinder-quobyte-35e84b6b-36a7-4aa4-bee2-cc8715f312c2" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Lock "cinder-quobyte-35e84b6b-36a7-4aa4-bee2-cc8715f312c2" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:10 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[65337545-a02d-4f53-a00c-bf89fec355c7]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:10 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 Jul 09 05:22:10 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:11 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2" returned: 0 in 0.727s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:11 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 Jul 09 05:22:11 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:12 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2" returned: 1 in 0.711s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:12 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2 Jul 09 05:22:12 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:12 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-35e84b6b-36a7-4aa4-bee2-cc8715f312c2" returned: 0 in 0.616s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Lock "cinder-quobyte-35e84b6b-36a7-4aa4-bee2-cc8715f312c2" released by "delete_volume" :: held 2.109s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Created reservations ['306859e4-d701-49cd-ba66-f40b06f2c090', 'ea25eaf7-a25b-433a-a24f-c95d5bbad1ea', '991717ae-7d04-45ca-8add-3ca93f570a13', 'c01d90e2-feb2-43fc-abf9-ecc23b07abed'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:12 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:22:12 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:13 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.602s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:13 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:22:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Deleted volume successfully. Jul 09 05:22:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0b92a2a9-bdc9-4844-8f5e-29978ae584e0 tempest-VolumeImageDependencyTests-2052595322 None] Lock "cinder-35e84b6b-36a7-4aa4-bee2-cc8715f312c2-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:22 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=50,cinder:UPDATE=70,cinder:INSERT=23,cinder:DELETE=9 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:22:23 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=54,cinder:UPDATE=80,cinder:DELETE=4,cinder:INSERT=20 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Flow 'volume_create_manager' (e44726b0-b40c-4582-ae3d-62217dbd214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0460674-40d8-4e11-adc3-e78b83c85fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0460674-40d8-4e11-adc3-e78b83c85fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-707381607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5e3e85-5da6-473f-9a52-aac295a2607a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5086e2d76bc246eea5953469e731be83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:25Z,use_quota=True,user_id='cd69980c392143af87fbfc68c02fa28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff034ad-531e-452b-9668-a09bf18d17d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff034ad-531e-452b-9668-a09bf18d17d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b60654f-bda4-452f-acda-66cebc0473a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b60654f-bda4-452f-acda-66cebc0473a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc5e3e85-5da6-473f-9a52-aac295a2607a', 'volume_name': 'volume-cc5e3e85-5da6-473f-9a52-aac295a2607a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc590deb-c0e8-4917-8eb6-896667f20943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc590deb-c0e8-4917-8eb6-896667f20943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa70ae0-3786-49ff-a7be-4214cc9b5368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:25 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Volume cc5e3e85-5da6-473f-9a52-aac295a2607a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc5e3e85-5da6-473f-9a52-aac295a2607a', 'volume_size': 1} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-707381607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5e3e85-5da6-473f-9a52-aac295a2607a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5086e2d76bc246eea5953469e731be83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:25Z,use_quota=True,user_id='cd69980c392143af87fbfc68c02fa28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Creating volume cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:25 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:25 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a 1073741824 Jul 09 05:22:25 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Flow 'volume_create_manager' (7a1aa8c8-65fd-4be8-bdde-ebe4342ec57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fd089c-7ad1-4d43-89af-713a755cd0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fd089c-7ad1-4d43-89af-713a755cd0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-642550328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b2f97d-c7ce-4614-9d85-fcbb8633358a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549ef096895a4cd9ac6941c70d8dc3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:26Z,use_quota=True,user_id='f678ddcd793a42f3ba8de727a0c2f433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19a4194-8380-47e3-88e7-3bd8a1512edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19a4194-8380-47e3-88e7-3bd8a1512edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25e8bbd-0135-4114-b805-8f129fe8bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25e8bbd-0135-4114-b805-8f129fe8bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b2f97d-c7ce-4614-9d85-fcbb8633358a', 'volume_name': 'volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3304228-f084-42fc-bb54-a0bf7213cf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3304228-f084-42fc-bb54-a0bf7213cf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90ae798-3c93-4283-821d-dd2d0bfaae34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:25 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Volume 43b2f97d-c7ce-4614-9d85-fcbb8633358a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a', 'volume_size': 1} Jul 09 05:22:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Flow 'volume_create_manager' (899f8bd0-4034-410d-8520-0b44229d8a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f36a8ca-4fc7-4a35-992b-d4f88e823c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f36a8ca-4fc7-4a35-992b-d4f88e823c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834368340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8db5212-7866-45eb-bdd1-c580cb0efd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549ef096895a4cd9ac6941c70d8dc3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:26Z,use_quota=True,user_id='f678ddcd793a42f3ba8de727a0c2f433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b81bc1f-f1f7-4643-b921-75d298de52c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b81bc1f-f1f7-4643-b921-75d298de52c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27721f1b-f155-450b-8289-d6772f33e267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27721f1b-f155-450b-8289-d6772f33e267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8db5212-7866-45eb-bdd1-c580cb0efd16', 'volume_name': 'volume-e8db5212-7866-45eb-bdd1-c580cb0efd16', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5677cf-a9fc-4171-86ae-34c33409ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5677cf-a9fc-4171-86ae-34c33409ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d543c08-74ac-4ef3-96ae-07d72c5c5e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:26 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Volume e8db5212-7866-45eb-bdd1-c580cb0efd16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8db5212-7866-45eb-bdd1-c580cb0efd16', 'volume_size': 1} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Flow 'volume_create_manager' (4b621e1a-2333-4c47-aa71-a6acb4fb98fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470893c7-3088-4a95-83a0-d7d0482d555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470893c7-3088-4a95-83a0-d7d0482d555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-808975366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458c429b-e4f3-42bc-ba11-c0abe2c870cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549ef096895a4cd9ac6941c70d8dc3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:27Z,use_quota=True,user_id='f678ddcd793a42f3ba8de727a0c2f433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd01000-a454-4a41-91e7-c5f738d92918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd01000-a454-4a41-91e7-c5f738d92918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef82c526-09fd-47b4-8cba-b9dbe597c743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef82c526-09fd-47b4-8cba-b9dbe597c743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '458c429b-e4f3-42bc-ba11-c0abe2c870cf', 'volume_name': 'volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e3c40d-17ba-477f-b47d-c030522b999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e3c40d-17ba-477f-b47d-c030522b999f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b940afbc-e105-429e-a807-8779cee67dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:26 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Volume 458c429b-e4f3-42bc-ba11-c0abe2c870cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf', 'volume_size': 1} Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:26 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a 1073741824" returned: 0 in 1.435s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:27 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a Jul 09 05:22:27 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Flow 'volume_create_manager' (f0ad27f8-be8b-486b-91ab-77df99d306b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfdf6bf-8c7b-4d4c-ac38-dd79bd30f528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfdf6bf-8c7b-4d4c-ac38-dd79bd30f528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066207078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e31140-b3d5-453a-8e35-ba1759d47d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549ef096895a4cd9ac6941c70d8dc3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:27Z,use_quota=True,user_id='f678ddcd793a42f3ba8de727a0c2f433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcbc13e-fdf0-4f27-b462-7f6c022ebb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcbc13e-fdf0-4f27-b462-7f6c022ebb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdf3a35-ff6e-4796-a126-557f46d99f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdf3a35-ff6e-4796-a126-557f46d99f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e31140-b3d5-453a-8e35-ba1759d47d07', 'volume_name': 'volume-63e31140-b3d5-453a-8e35-ba1759d47d07', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410d090a-fccb-4227-a01e-e2cb7d17c584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410d090a-fccb-4227-a01e-e2cb7d17c584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70c1a23-e248-4a10-b276-b16de69482d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:27 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Volume 63e31140-b3d5-453a-8e35-ba1759d47d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e31140-b3d5-453a-8e35-ba1759d47d07', 'volume_size': 1} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:27 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a" returned: 0 in 0.909s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] <== create_volume: return (2398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.401s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.102s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-642550328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b2f97d-c7ce-4614-9d85-fcbb8633358a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549ef096895a4cd9ac6941c70d8dc3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:26Z,use_quota=True,user_id='f678ddcd793a42f3ba8de727a0c2f433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Creating volume 43b2f97d-c7ce-4614-9d85-fcbb8633358a {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:27 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:22:27 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a 1073741824 Jul 09 05:22:27 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Flow 'volume_create_manager' (a809af21-cad2-487c-ba83-bcebf42d4f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fd524c-a21f-4726-996b-b55e085af217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa70ae0-3786-49ff-a7be-4214cc9b5368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5e3e85-5da6-473f-9a52-aac295a2607a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097f03bb-1753-4afb-b8b5-316047f03e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fd524c-a21f-4726-996b-b55e085af217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-252311861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7e6106-8c6c-42bd-b572-a294f0332987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549ef096895a4cd9ac6941c70d8dc3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:28Z,use_quota=True,user_id='f678ddcd793a42f3ba8de727a0c2f433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee16e23e-3b98-4797-8d49-4ef997fe6503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee16e23e-3b98-4797-8d49-4ef997fe6503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06f2c55-9535-433e-95de-e67060a05d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06f2c55-9535-433e-95de-e67060a05d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7e6106-8c6c-42bd-b572-a294f0332987', 'volume_name': 'volume-6c7e6106-8c6c-42bd-b572-a294f0332987', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2d2281-602d-4633-97dc-4ba5218521c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2d2281-602d-4633-97dc-4ba5218521c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dded0c2-3a76-4c8b-8c62-bd585cae7acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:28 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Volume 6c7e6106-8c6c-42bd-b572-a294f0332987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7e6106-8c6c-42bd-b572-a294f0332987', 'volume_size': 1} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:28 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Volume volume-cc5e3e85-5da6-473f-9a52-aac295a2607a (cc5e3e85-5da6-473f-9a52-aac295a2607a): created successfully Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097f03bb-1753-4afb-b8b5-316047f03e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Flow 'volume_create_manager' (e44726b0-b40c-4582-ae3d-62217dbd214f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-96a31736-d6b1-4a8d-836b-21cd59482136 tempest-VolumeDependencyTests-9432178 None] Created volume successfully. Jul 09 05:22:29 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a 1073741824" returned: 0 in 1.131s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:22:29 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a Jul 09 05:22:29 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Flow 'volume_create_manager' (3f0a6c28-4cf8-4505-a823-914e5c8c078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd670f2-1a78-45fb-bf18-18b9646e2247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd670f2-1a78-45fb-bf18-18b9646e2247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fe0467-d40e-49c6-b59e-0d01dd9e2daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8526786825443bb8b00c122378d529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:29Z,use_quota=True,user_id='8c42317bd554439ab0a1442fffab50de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795b4218-1d10-430b-b720-7c1babcc70e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795b4218-1d10-430b-b720-7c1babcc70e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7e7712-a53c-4f16-9222-0693c9d377cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.image.glance [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Creating Keystone auth plugin from conf {{(pid=87161) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7e7712-a53c-4f16-9222-0693c9d377cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10fe0467-d40e-49c6-b59e-0d01dd9e2daa', 'volume_name': 'volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa', 'volume_size': 1, 'image_id': '2194e51f-f19d-4eba-a7fb-31d1d9898982', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2194e51f-f19d-4eba-a7fb-31d1d9898982', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bdab55073e4cf67e7644f402014d371a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c8526786825443bb8b00c122378d529', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94f8d2ad868ceb1ca3a453004cebe92fe99fe3f2affad4ffdf30804a05dbbd958fd1bad6e744cd13273665ff47266264684e8d63e1e025d63e9e09b3e24584d4', 'id': '2194e51f-f19d-4eba-a7fb-31d1d9898982', 'created_at': datetime.datetime(2026, 7, 9, 3, 22, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2194e51f-f19d-4eba-a7fb-31d1d9898982/file', 'properties': {}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3282f2f8-c35b-4662-974d-580e80fc844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3282f2f8-c35b-4662-974d-580e80fc844f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7443b247-040a-4764-9c91-6c6c9ad796dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:29 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Volume 10fe0467-d40e-49c6-b59e-0d01dd9e2daa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa', 'volume_size': 1, 'image_id': '2194e51f-f19d-4eba-a7fb-31d1d9898982', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2194e51f-f19d-4eba-a7fb-31d1d9898982', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bdab55073e4cf67e7644f402014d371a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c8526786825443bb8b00c122378d529', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94f8d2ad868ceb1ca3a453004cebe92fe99fe3f2affad4ffdf30804a05dbbd958fd1bad6e744cd13273665ff47266264684e8d63e1e025d63e9e09b3e24584d4', 'id': '2194e51f-f19d-4eba-a7fb-31d1d9898982', 'created_at': datetime.datetime(2026, 7, 9, 3, 22, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2194e51f-f19d-4eba-a7fb-31d1d9898982/file', 'properties': {}}, 'image_service': } Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Trying to clone 10fe0467-d40e-49c6-b59e-0d01dd9e2daa from image 2194e51f-f19d-4eba-a7fb-31d1d9898982 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2194e51f-f19d-4eba-a7fb-31d1d9898982', 'metadata': {}}]). {{(pid=87161) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 05:22:29 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Image download 0.00 MB at 0.00 MB/s Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9807e527-e1a1-44fc-a9ac-cf0c83e59eb9]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:29 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD Jul 09 05:22:29 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:29 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a" returned: 0 in 0.710s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.464s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834368340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8db5212-7866-45eb-bdd1-c580cb0efd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549ef096895a4cd9ac6941c70d8dc3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:26Z,use_quota=True,user_id='f678ddcd793a42f3ba8de727a0c2f433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Creating volume e8db5212-7866-45eb-bdd1-c580cb0efd16 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:29 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90ae798-3c93-4283-821d-dd2d0bfaae34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:29 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16 1073741824 Jul 09 05:22:29 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cd5d4c-76c2-4192-9a5c-9ec432be7a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:29 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Volume volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a (43b2f97d-c7ce-4614-9d85-fcbb8633358a): created successfully Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cd5d4c-76c2-4192-9a5c-9ec432be7a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:29 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Flow 'volume_create_manager' (7a1aa8c8-65fd-4be8-bdde-ebe4342ec57c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a8338bbc-4142-4b49-92f6-160eeec13019 tempest-CreateVolumesFromImageTest-1226788738 None] Created volume successfully. Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Flow 'volume_create_manager' (35d75e3e-4de9-4edd-9aba-d604ad7d60c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb75476-0f09-489b-9700-a978d78957f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb75476-0f09-489b-9700-a978d78957f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f22dc56-9333-4226-8a2e-3ad5b132f2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd7697d248a42c4a1c6afe150889fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:30Z,use_quota=True,user_id='128b3d8a2cc14c3bb7c148793214f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce90661-803f-43b9-b6b2-cb0afb0e954c),volume_type_id=4ce90661-803f-43b9-b6b2-cb0afb0e954c)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c97eedf-1b21-4b28-ac4f-a505474d4d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c97eedf-1b21-4b28-ac4f-a505474d4d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce18cdac-42b0-4751-a34e-9c6b4373a3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.image.glance [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Creating Keystone auth plugin from conf {{(pid=87161) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce18cdac-42b0-4751-a34e-9c6b4373a3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f22dc56-9333-4226-8a2e-3ad5b132f2eb', 'volume_name': 'volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb', 'volume_size': 1, 'image_id': '6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'efb8fef8cbf25dc86190efe24422d85e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fd7697d248a42c4a1c6afe150889fc5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd12b8cbd6995baf122c96fb5e4977316f390ccd2a8de47e5b4b81fb3d75eee6c7a085f260092e615ceb67864a9cc999a9e28d1138978e6c83401ef8d5ea2a8af', 'id': '6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'created_at': datetime.datetime(2026, 7, 9, 3, 22, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 22, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d92dcbf-bdbb-4506-9c62-faa61f16b839/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f07c565-50b5-4a36-8f3f-fca30c621e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f07c565-50b5-4a36-8f3f-fca30c621e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07482e2-de72-4414-9575-00f469a426d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:30 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Volume 1f22dc56-9333-4226-8a2e-3ad5b132f2eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb', 'volume_size': 1, 'image_id': '6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'efb8fef8cbf25dc86190efe24422d85e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fd7697d248a42c4a1c6afe150889fc5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd12b8cbd6995baf122c96fb5e4977316f390ccd2a8de47e5b4b81fb3d75eee6c7a085f260092e615ceb67864a9cc999a9e28d1138978e6c83401ef8d5ea2a8af', 'id': '6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'created_at': datetime.datetime(2026, 7, 9, 3, 22, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 22, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d92dcbf-bdbb-4506-9c62-faa61f16b839/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Trying to clone 1f22dc56-9333-4226-8a2e-3ad5b132f2eb from image 6d92dcbf-bdbb-4506-9c62-faa61f16b839 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'metadata': {}}]). {{(pid=87161) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 05:22:30 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 05:22:30 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Image download 0.00 MB at 0.00 MB/s Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a1bf25-a1bb-4c4c-9bae-c830ef48fdd8]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:30 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD Jul 09 05:22:30 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:30 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD Jul 09 05:22:30 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:30 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16 1073741824" returned: 0 in 0.993s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:30 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16 Jul 09 05:22:30 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:31 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD" returned: 1 in 0.843s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Temporary image 2194e51f-f19d-4eba-a7fb-31d1d9898982 is fetched for user 8c42317bd554439ab0a1442fffab50de. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 05:22:31 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD" returned: 0 in 0.829s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba170077-a559-4da6-bbe5-927c01bc812e]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:31 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD Jul 09 05:22:31 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:31 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD Jul 09 05:22:31 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:31 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16" returned: 0 in 0.664s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.599s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-808975366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458c429b-e4f3-42bc-ba11-c0abe2c870cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549ef096895a4cd9ac6941c70d8dc3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:27Z,use_quota=True,user_id='f678ddcd793a42f3ba8de727a0c2f433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Creating volume 458c429b-e4f3-42bc-ba11-c0abe2c870cf {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:31 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d543c08-74ac-4ef3-96ae-07d72c5c5e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8db5212-7866-45eb-bdd1-c580cb0efd16', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:31 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf 1073741824 Jul 09 05:22:31 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e925a8-0dc5-4f74-a739-14942e065902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:31 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Volume volume-e8db5212-7866-45eb-bdd1-c580cb0efd16 (e8db5212-7866-45eb-bdd1-c580cb0efd16): created successfully Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e925a8-0dc5-4f74-a739-14942e065902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:31 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Flow 'volume_create_manager' (899f8bd0-4034-410d-8520-0b44229d8a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-95c6d8ce-ce12-4475-9d2c-0838ce37bd93 tempest-CreateVolumesFromImageTest-1226788738 None] Created volume successfully. Jul 09 05:22:32 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD" returned: 1 in 0.756s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Temporary image 6d92dcbf-bdbb-4506-9c62-faa61f16b839 is fetched for user 128b3d8a2cc14c3bb7c148793214f56d. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 05:22:32 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[874aaf1f-ad90-4e53-9bec-028fd591ae46]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:32 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD Jul 09 05:22:32 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:32 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD Jul 09 05:22:32 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:32 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf 1073741824" returned: 0 in 0.926s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:32 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf Jul 09 05:22:32 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:32 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD" returned: 1 in 0.755s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:33 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD" returned: 0 in 0.772s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:33 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD Jul 09 05:22:33 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:33 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf" returned: 0 in 0.681s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.724s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066207078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e31140-b3d5-453a-8e35-ba1759d47d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549ef096895a4cd9ac6941c70d8dc3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:27Z,use_quota=True,user_id='f678ddcd793a42f3ba8de727a0c2f433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Creating volume 63e31140-b3d5-453a-8e35-ba1759d47d07 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:33 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b940afbc-e105-429e-a807-8779cee67dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130aebdc-ba63-4f4a-80e2-0248c1867e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:33 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07 1073741824 Jul 09 05:22:33 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:33 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Volume volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf (458c429b-e4f3-42bc-ba11-c0abe2c870cf): created successfully Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130aebdc-ba63-4f4a-80e2-0248c1867e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Flow 'volume_create_manager' (4b621e1a-2333-4c47-aa71-a6acb4fb98fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7fb6276d-cc01-41c6-9431-4e7861365643 tempest-CreateVolumesFromImageTest-1226788738 None] Created volume successfully. Jul 09 05:22:33 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD" returned: 1 in 0.769s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:34 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07 1073741824" returned: 0 in 0.881s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:34 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07 Jul 09 05:22:34 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:34 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07" returned: 0 in 0.650s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.725s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-252311861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7e6106-8c6c-42bd-b572-a294f0332987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549ef096895a4cd9ac6941c70d8dc3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:28Z,use_quota=True,user_id='f678ddcd793a42f3ba8de727a0c2f433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Creating volume 6c7e6106-8c6c-42bd-b572-a294f0332987 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:34 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:34 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987 1073741824 Jul 09 05:22:34 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70c1a23-e248-4a10-b276-b16de69482d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e31140-b3d5-453a-8e35-ba1759d47d07', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f280e9-d198-45d6-9b7d-a90149b0fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:34 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Volume volume-63e31140-b3d5-453a-8e35-ba1759d47d07 (63e31140-b3d5-453a-8e35-ba1759d47d07): created successfully Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f280e9-d198-45d6-9b7d-a90149b0fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:34 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Flow 'volume_create_manager' (f0ad27f8-be8b-486b-91ab-77df99d306b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:34 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-fe4117c4-c1ff-48a7-8803-8490e87d8cb9 tempest-CreateVolumesFromImageTest-1226788738 None] Created volume successfully. Jul 09 05:22:35 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987 1073741824" returned: 0 in 0.851s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:35 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987 Jul 09 05:22:35 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:36 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987" returned: 0 in 0.636s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.229s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dded0c2-3a76-4c8b-8c62-bd585cae7acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7e6106-8c6c-42bd-b572-a294f0332987', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afb260c-c37a-4fe3-9196-f92b15452aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Creating offline snapshot 4763a337-5ef7-4bc3-9c75-40d429ea93f3 of volume cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:22:36 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Volume volume-6c7e6106-8c6c-42bd-b572-a294f0332987 (6c7e6106-8c6c-42bd-b572-a294f0332987): created successfully Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afb260c-c37a-4fe3-9196-f92b15452aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Flow 'volume_create_manager' (a809af21-cad2-487c-ba83-bcebf42d4f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0140d9-9402-4320-bdca-29b9c08243ad]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:36 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8b91cb71-cf7a-4182-93e5-90ea202646a6 tempest-CreateVolumesFromImageTest-1226788738 None] Created volume successfully. Jul 09 05:22:36 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a Jul 09 05:22:36 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "cinder-6c7e6106-8c6c-42bd-b572-a294f0332987-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-6c7e6106-8c6c-42bd-b572-a294f0332987-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "cinder-quobyte-6c7e6106-8c6c-42bd-b572-a294f0332987" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-quobyte-6c7e6106-8c6c-42bd-b572-a294f0332987" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea4db48-330c-44b6-983e-efda2dad3115]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:36 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987 Jul 09 05:22:36 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:37 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a" returned: 0 in 0.756s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:37 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 1G Jul 09 05:22:37 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:37 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987" returned: 0 in 0.808s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:37 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987 Jul 09 05:22:37 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:37 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 1G" returned: 0 in 0.801s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc5e3e85-5da6-473f-9a52-aac295a2607a -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:37 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc5e3e85-5da6-473f-9a52-aac295a2607a -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 Jul 09 05:22:37 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:38 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6c7e6106-8c6c-42bd-b572-a294f0332987" returned: 0 in 0.684s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-quobyte-6c7e6106-8c6c-42bd-b572-a294f0332987" released by "delete_volume" :: held 1.535s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Created reservations ['c2fb4657-71f8-42a9-91f5-c64551cd7554', 'ae7c6803-52f1-451b-ac0b-a6d101125b60', '413899cb-b96b-4d63-bffb-ec242117fea0', '2536ae6c-9c65-46fc-89f4-88ab4249e9b2'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:38 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:22:38 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:38 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc5e3e85-5da6-473f-9a52-aac295a2607a -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3" returned: 0 in 0.749s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:38 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 is being set with open permissions: ugo+rw Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:38 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 Jul 09 05:22:38 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "cinder-63e31140-b3d5-453a-8e35-ba1759d47d07-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-63e31140-b3d5-453a-8e35-ba1759d47d07-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "cinder-quobyte-63e31140-b3d5-453a-8e35-ba1759d47d07" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:39 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:22:39 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-quobyte-63e31140-b3d5-453a-8e35-ba1759d47d07" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fc2930-e9ac-449c-b472-dfd370cd0edf]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:39 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.692s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:22:39 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Deleted volume successfully. Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b41c11d-6b22-4852-97f9-3849bee9ec41 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-6c7e6106-8c6c-42bd-b572-a294f0332987-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:39 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07 Jul 09 05:22:39 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:39 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3" returned: 0 in 0.664s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:39 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.info Jul 09 05:22:39 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:39 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.762s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:22:39 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07" returned: 0 in 0.829s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:40 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07 Jul 09 05:22:40 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:40 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.info" returned: 0 in 0.664s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:40 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.info is being set with open permissions: ugo+rw Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:40 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.info Jul 09 05:22:40 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:40 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-63e31140-b3d5-453a-8e35-ba1759d47d07" returned: 0 in 0.698s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-quobyte-63e31140-b3d5-453a-8e35-ba1759d47d07" released by "delete_volume" :: held 1.576s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:40 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.info" returned: 0 in 0.686s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.446s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.822s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fe0467-d40e-49c6-b59e-0d01dd9e2daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8526786825443bb8b00c122378d529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:29Z,use_quota=True,user_id='8c42317bd554439ab0a1442fffab50de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Creating volume 10fe0467-d40e-49c6-b59e-0d01dd9e2daa {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:40 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Created reservations ['c599b030-85e1-44b9-87b3-1c00a43b7aee', '79f10de0-0bdd-406a-8ab1-ed66172790ab', 'c4c20d4e-ae00-408f-89fd-333f473ec1e4', '88f38336-4f3f-4497-b0b4-f045fe989379'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:22:40 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa 1073741824 Jul 09 05:22:40 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:40 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-64ba1382-6f27-4be5-926f-5d7bb0247234 tempest-VolumeDependencyTests-9432178 None] Create snapshot completed successfully Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:40 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:22:40 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "cinder-458c429b-e4f3-42bc-ba11-c0abe2c870cf-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-458c429b-e4f3-42bc-ba11-c0abe2c870cf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "cinder-quobyte-458c429b-e4f3-42bc-ba11-c0abe2c870cf" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-quobyte-458c429b-e4f3-42bc-ba11-c0abe2c870cf" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[955e8b5b-10e2-4c49-a54b-472b84ef6d3a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:41 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf Jul 09 05:22:41 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:41 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.653s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:22:41 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Deleted volume successfully. Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1ce6a940-b9ea-45ab-92a6-9dd861459328 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-63e31140-b3d5-453a-8e35-ba1759d47d07-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:41 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa 1073741824" returned: 0 in 0.930s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:41 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa Jul 09 05:22:41 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:42 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf" returned: 0 in 0.858s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:42 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf Jul 09 05:22:42 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Flow 'volume_create_manager' (3f7608c9-b385-470d-9fc5-ee9a896d11f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c16e8e-7a68-4b03-bd39-1de745644281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c16e8e-7a68-4b03-bd39-1de745644281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-628474477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8048fd4a-ec48-4778-b74d-03f8ec54d61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5086e2d76bc246eea5953469e731be83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4763a337-5ef7-4bc3-9c75-40d429ea93f3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:42Z,use_quota=True,user_id='cd69980c392143af87fbfc68c02fa28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab14ec9-beeb-4a94-9c7e-422a6b7541b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab14ec9-beeb-4a94-9c7e-422a6b7541b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947d4030-056f-4507-b392-e8b5f4e643d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947d4030-056f-4507-b392-e8b5f4e643d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8048fd4a-ec48-4778-b74d-03f8ec54d61b', 'volume_name': 'volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b', 'volume_size': 1, 'snapshot_id': '4763a337-5ef7-4bc3-9c75-40d429ea93f3'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764a026c-6e10-43ec-ac28-1f042cbb0ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764a026c-6e10-43ec-ac28-1f042cbb0ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ca3bc9-ed48-4967-860f-549706d7a2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Volume 8048fd4a-ec48-4778-b74d-03f8ec54d61b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b', 'volume_size': 1, 'snapshot_id': '4763a337-5ef7-4bc3-9c75-40d429ea93f3'} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:42 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa" returned: 0 in 0.750s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.702s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f22dc56-9333-4226-8a2e-3ad5b132f2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd7697d248a42c4a1c6afe150889fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:30Z,use_quota=True,user_id='128b3d8a2cc14c3bb7c148793214f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce90661-803f-43b9-b6b2-cb0afb0e954c),volume_type_id=4ce90661-803f-43b9-b6b2-cb0afb0e954c)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Creating volume 1f22dc56-9333-4226-8a2e-3ad5b132f2eb {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:42 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:42 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb 1073741824 Jul 09 05:22:42 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Attempting download of 2194e51f-f19d-4eba-a7fb-31d1d9898982 ((None, [{'url': 'file:///opt/stack/data/glance/images/2194e51f-f19d-4eba-a7fb-31d1d9898982', 'metadata': {}}])) to volume 10fe0467-d40e-49c6-b59e-0d01dd9e2daa. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf41367b-098b-43a8-a042-3dc131c06a57]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2194e51f-f19d-4eba-a7fb-31d1d9898982_1jtlr3jy {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:42 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2194e51f-f19d-4eba-a7fb-31d1d9898982_1jtlr3jy Jul 09 05:22:42 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:42 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-458c429b-e4f3-42bc-ba11-c0abe2c870cf" returned: 0 in 0.707s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-quobyte-458c429b-e4f3-42bc-ba11-c0abe2c870cf" released by "delete_volume" :: held 1.634s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Created reservations ['bd04efbb-d524-4aa5-b614-49711b97769a', '978087a1-4719-414d-a08b-92b6898cdb9c', '9e1eeb63-0cad-418c-8849-9fcd70d2b498', '8dc6030c-f5db-4e17-8d6d-fc8cc2b07cb9'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:43 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:22:43 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:43 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb 1073741824" returned: 0 in 0.900s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:43 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2194e51f-f19d-4eba-a7fb-31d1d9898982_1jtlr3jy" returned: 0 in 0.828s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2194e51f-f19d-4eba-a7fb-31d1d9898982_1jtlr3jy {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "cinder-e8db5212-7866-45eb-bdd1-c580cb0efd16-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-e8db5212-7866-45eb-bdd1-c580cb0efd16-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:43 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb Jul 09 05:22:43 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "cinder-quobyte-e8db5212-7866-45eb-bdd1-c580cb0efd16" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-quobyte-e8db5212-7866-45eb-bdd1-c580cb0efd16" acquired by "delete_volume" :: waited 0.027s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0104d310-1b35-4127-9e02-136feb495a2f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:43 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2194e51f-f19d-4eba-a7fb-31d1d9898982_1jtlr3jy Jul 09 05:22:43 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:43 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16 Jul 09 05:22:43 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:43 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.759s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:22:43 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Deleted volume successfully. Jul 09 05:22:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-98f7f1fb-a4dc-4458-829d-26e452ec99b1 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-458c429b-e4f3-42bc-ba11-c0abe2c870cf-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:44 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb" returned: 0 in 0.700s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.810s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "cinder-quobyte-4763a337-5ef7-4bc3-9c75-40d429ea93f3-8048fd4a-ec48-4778-b74d-03f8ec54d61b" by "_create_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-4763a337-5ef7-4bc3-9c75-40d429ea93f3-8048fd4a-ec48-4778-b74d-03f8ec54d61b" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Creating volume 8048fd4a-ec48-4778-b74d-03f8ec54d61b from snapshot 4763a337-5ef7-4bc3-9c75-40d429ea93f3 {{(pid=87161) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "cinder-quobyte-8048fd4a-ec48-4778-b74d-03f8ec54d61b" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-8048fd4a-ec48-4778-b74d-03f8ec54d61b" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] snapshot: 4763a337-5ef7-4bc3-9c75-40d429ea93f3, volume: 8048fd4a-ec48-4778-b74d-03f8ec54d61b, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Attempting download of 6d92dcbf-bdbb-4506-9c62-faa61f16b839 ((None, [{'url': 'file:///opt/stack/data/glance/images/6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'metadata': {}}])) to volume 1f22dc56-9333-4226-8a2e-3ad5b132f2eb. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3344e34-9480-484a-b10e-e40130f70bba]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:44 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ccf2e-dc08-4bf1-b8d6-94d7d9dff69f]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d92dcbf-bdbb-4506-9c62-faa61f16b839_mn03_udy {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2194e51f-f19d-4eba-a7fb-31d1d9898982_1jtlr3jy" returned: 1 in 0.940s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2194e51f-f19d-4eba-a7fb-31d1d9898982_1jtlr3jy' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ec3038-1c2e-4ef0-8e4e-51b0d0047336]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:44 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 Jul 09 05:22:44 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:44 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d92dcbf-bdbb-4506-9c62-faa61f16b839_mn03_udy Jul 09 05:22:44 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:44 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16" returned: 0 in 0.869s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:44 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD Jul 09 05:22:44 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:44 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16 Jul 09 05:22:44 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:45 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:45 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3" returned: 0 in 0.886s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc5e3e85-5da6-473f-9a52-aac295a2607a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[702e7e7b-11ac-4271-8139-97ad831fc2bf]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:45 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d92dcbf-bdbb-4506-9c62-faa61f16b839_mn03_udy" returned: 0 in 0.902s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d92dcbf-bdbb-4506-9c62-faa61f16b839_mn03_udy {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:45 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e8db5212-7866-45eb-bdd1-c580cb0efd16" returned: 0 in 0.811s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-quobyte-e8db5212-7866-45eb-bdd1-c580cb0efd16" released by "delete_volume" :: held 1.743s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:45 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD Jul 09 05:22:45 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:45 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a Jul 09 05:22:45 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Created reservations ['13e1149d-e598-471d-84c4-12df409f84b0', '4d439d3d-5975-4f46-af55-fd6591e5c367', 'dc9942b2-8c4c-4f34-bd9d-13b4c662e103', 'f764934b-196a-4129-ba14-4e8fc00739a3'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:22:45 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d92dcbf-bdbb-4506-9c62-faa61f16b839_mn03_udy Jul 09 05:22:45 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:45 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:22:45 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "cinder-43b2f97d-c7ce-4614-9d85-fcbb8633358a-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-43b2f97d-c7ce-4614-9d85-fcbb8633358a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "cinder-quobyte-43b2f97d-c7ce-4614-9d85-fcbb8633358a" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-quobyte-43b2f97d-c7ce-4614-9d85-fcbb8633358a" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c7ae78-35ae-4cb5-b14f-30a48f2a4c6d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:46 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d92dcbf-bdbb-4506-9c62-faa61f16b839_mn03_udy" returned: 1 in 0.936s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d92dcbf-bdbb-4506-9c62-faa61f16b839_mn03_udy' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d16d6d7-5d37-4f7d-9f90-3f030bd6b3ce]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:46 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a" returned: 0 in 0.998s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:46 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:22:46 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a Jul 09 05:22:46 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b Jul 09 05:22:46 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:46 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:46 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Deleted volume successfully. Jul 09 05:22:46 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD" returned: 1 in 1.099s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] 2194e51f-f19d-4eba-a7fb-31d1d9898982 was raw, converting to raw {{(pid=87161) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c520e305-40c6-4b98-85f3-d9f6d8d50f80 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-e8db5212-7866-45eb-bdd1-c580cb0efd16-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:46 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa Jul 09 05:22:46 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD Jul 09 05:22:46 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:46 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:47 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a" returned: 0 in 0.919s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:47 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:47 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a Jul 09 05:22:47 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD" returned: 0 in 0.864s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:47 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa" returned: 0 in 0.843s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:47 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2194e51f-f19d-4eba-a7fb-31d1d9898982_ww7jf87edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:22:47 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 05:22:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:47 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa 1G Jul 09 05:22:47 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:47 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD Jul 09 05:22:47 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:48 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-43b2f97d-c7ce-4614-9d85-fcbb8633358a" returned: 0 in 1.455s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-quobyte-43b2f97d-c7ce-4614-9d85-fcbb8633358a" released by "delete_volume" :: held 2.476s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:48 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Created reservations ['12090809-143a-48b8-ae68-378508f3eb2f', '068f3881-e10d-4029-a107-b1db1398d69c', '0425f03b-7ce5-4bd5-b41f-b643dd4e7928', 'dd5ae5c6-0d22-4802-a59d-a53f38c658f0'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:22:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:49 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:22:49 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:49 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa 1G" returned: 0 in 2.021s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:49 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96835b6-aa57-4cba-b7d4-27ed0cb72bfd]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:50 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD" returned: 1 in 2.914s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:50 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] 6d92dcbf-bdbb-4506-9c62-faa61f16b839 was raw, converting to raw {{(pid=87161) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 05:22:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:50 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa Jul 09 05:22:50 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:50 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb Jul 09 05:22:50 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:51 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 2.055s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:51 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:22:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Deleted volume successfully. Jul 09 05:22:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b399e581-818e-4e59-b03f-efb749cedcc8 tempest-CreateVolumesFromImageTest-1226788738 None] Lock "cinder-43b2f97d-c7ce-4614-9d85-fcbb8633358a-delete_volume" released by "delete_volume" :: held 5.202s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:52 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa" returned: 0 in 3.005s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:52 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa Jul 09 05:22:52 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:52 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb" returned: 0 in 2.510s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:52 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6d92dcbf-bdbb-4506-9c62-faa61f16b839_n5h_dq24devstack@QuobyteHD, size 0.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:22:52 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 05:22:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:52 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b" returned: 0 in 6.306s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:52 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3242ff7c-93e9-4d53-bb87-e9a6241ae30d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:52 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb 1G Jul 09 05:22:52 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:52 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a Jul 09 05:22:52 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:53 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa" returned: 1 in 0.923s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Downloaded image 2194e51f-f19d-4eba-a7fb-31d1d9898982 ((None, [{'url': 'file:///opt/stack/data/glance/images/2194e51f-f19d-4eba-a7fb-31d1d9898982', 'metadata': {}}])) to volume 10fe0467-d40e-49c6-b59e-0d01dd9e2daa successfully. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Temporary image 2194e51f-f19d-4eba-a7fb-31d1d9898982 for user 8c42317bd554439ab0a1442fffab50de is deleted. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Marking volume 10fe0467-d40e-49c6-b59e-0d01dd9e2daa as bootable. {{(pid=87161) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Copying metadata from image 2194e51f-f19d-4eba-a7fb-31d1d9898982 to 10fe0467-d40e-49c6-b59e-0d01dd9e2daa. {{(pid=87161) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Creating volume glance metadata for volume 10fe0467-d40e-49c6-b59e-0d01dd9e2daa backed by image 2194e51f-f19d-4eba-a7fb-31d1d9898982 with: {'image_id': '2194e51f-f19d-4eba-a7fb-31d1d9898982', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'bdab55073e4cf67e7644f402014d371a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87161) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 05:22:53 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb 1G" returned: 0 in 0.776s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7443b247-040a-4764-9c91-6c6c9ad796dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa', 'volume_size': 1, 'image_id': '2194e51f-f19d-4eba-a7fb-31d1d9898982', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2194e51f-f19d-4eba-a7fb-31d1d9898982', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bdab55073e4cf67e7644f402014d371a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c8526786825443bb8b00c122378d529', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94f8d2ad868ceb1ca3a453004cebe92fe99fe3f2affad4ffdf30804a05dbbd958fd1bad6e744cd13273665ff47266264684e8d63e1e025d63e9e09b3e24584d4', 'id': '2194e51f-f19d-4eba-a7fb-31d1d9898982', 'created_at': datetime.datetime(2026, 7, 9, 3, 22, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2194e51f-f19d-4eba-a7fb-31d1d9898982/file', 'properties': {}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f5beed-150d-4f03-9263-5383e7e6a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:53 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Volume volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa (10fe0467-d40e-49c6-b59e-0d01dd9e2daa): created successfully Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f5beed-150d-4f03-9263-5383e7e6a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Flow 'volume_create_manager' (3f0a6c28-4cf8-4505-a823-914e5c8c078f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[850b754f-bd1e-4548-8a81-982e48d4dfb9]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:53 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-dfb35b5b-dfde-49c0-8792-100b6495102d tempest-VolumeImageDependencyTests-1638955043 None] Created volume successfully. Jul 09 05:22:53 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb Jul 09 05:22:53 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Acquiring lock "cinder-10fe0467-d40e-49c6-b59e-0d01dd9e2daa-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Lock "cinder-10fe0467-d40e-49c6-b59e-0d01dd9e2daa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Acquiring lock "cinder-quobyte-10fe0467-d40e-49c6-b59e-0d01dd9e2daa" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Lock "cinder-quobyte-10fe0467-d40e-49c6-b59e-0d01dd9e2daa" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:53 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a" returned: 0 in 1.157s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:22:53 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Converted 1024.00 MB image at 162.33 MB/s Jul 09 05:22:53 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b is being set with open permissions: ugo+rw Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d036130e-780a-419d-918d-091077951e96]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:53 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b Jul 09 05:22:53 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:53 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa Jul 09 05:22:53 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:54 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb" returned: 0 in 0.931s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:54 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb Jul 09 05:22:54 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:54 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b" returned: 0 in 0.736s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-8048fd4a-ec48-4778-b74d-03f8ec54d61b" released by "_copy_volume_from_snapshot" :: held 10.236s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-4763a337-5ef7-4bc3-9c75-40d429ea93f3-8048fd4a-ec48-4778-b74d-03f8ec54d61b" released by "_create_volume_from_snapshot" :: held 10.286s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.313s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ca3bc9-ed48-4967-860f-549706d7a2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b', 'volume_size': 1, 'snapshot_id': '4763a337-5ef7-4bc3-9c75-40d429ea93f3'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe6473e-ea6a-4e8b-b9f5-e692bb9c1772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:54 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Volume volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b (8048fd4a-ec48-4778-b74d-03f8ec54d61b): created successfully Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe6473e-ea6a-4e8b-b9f5-e692bb9c1772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Flow 'volume_create_manager' (3f7608c9-b385-470d-9fc5-ee9a896d11f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:54 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa" returned: 0 in 0.932s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c8cb8582-0bdd-4720-a096-34e2ca196f99 tempest-VolumeDependencyTests-9432178 None] Created volume successfully. Jul 09 05:22:54 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa Jul 09 05:22:54 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (d6a3a29c-0415-4d17-b9f9-58ff5787a2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ec2e68-db5a-4c5f-983c-86a61664134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ec2e68-db5a-4c5f-983c-86a61664134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1170178623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59818b3-c831-4353-b316-b5b09e8d478c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:55Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa9372a-da61-4524-9125-2667f2169fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa9372a-da61-4524-9125-2667f2169fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c596f3a3-3778-43b1-b868-a1a4c7fc8358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c596f3a3-3778-43b1-b868-a1a4c7fc8358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f59818b3-c831-4353-b316-b5b09e8d478c', 'volume_name': 'volume-f59818b3-c831-4353-b316-b5b09e8d478c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a6e644-1e68-4e52-90d5-41e472d1f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a6e644-1e68-4e52-90d5-41e472d1f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb908e6e-e98b-4809-a8cc-3fade2ce3682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:54 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume f59818b3-c831-4353-b316-b5b09e8d478c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f59818b3-c831-4353-b316-b5b09e8d478c', 'volume_size': 1} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1170178623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59818b3-c831-4353-b316-b5b09e8d478c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:22:55Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Creating volume f59818b3-c831-4353-b316-b5b09e8d478c {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:22:54 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:22:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:54 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c 1073741824 Jul 09 05:22:54 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:55 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb" returned: 1 in 0.849s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Downloaded image 6d92dcbf-bdbb-4506-9c62-faa61f16b839 ((None, [{'url': 'file:///opt/stack/data/glance/images/6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'metadata': {}}])) to volume 1f22dc56-9333-4226-8a2e-3ad5b132f2eb successfully. {{(pid=87161) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Temporary image 6d92dcbf-bdbb-4506-9c62-faa61f16b839 for user 128b3d8a2cc14c3bb7c148793214f56d is deleted. {{(pid=87161) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.volume.volume_utils [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Marking volume 1f22dc56-9333-4226-8a2e-3ad5b132f2eb as bootable. {{(pid=87161) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Copying metadata from image 6d92dcbf-bdbb-4506-9c62-faa61f16b839 to 1f22dc56-9333-4226-8a2e-3ad5b132f2eb. {{(pid=87161) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Creating volume glance metadata for volume 1f22dc56-9333-4226-8a2e-3ad5b132f2eb backed by image 6d92dcbf-bdbb-4506-9c62-faa61f16b839 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'efb8fef8cbf25dc86190efe24422d85e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87161) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07482e2-de72-4414-9575-00f469a426d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb', 'volume_size': 1, 'image_id': '6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'efb8fef8cbf25dc86190efe24422d85e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fd7697d248a42c4a1c6afe150889fc5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd12b8cbd6995baf122c96fb5e4977316f390ccd2a8de47e5b4b81fb3d75eee6c7a085f260092e615ceb67864a9cc999a9e28d1138978e6c83401ef8d5ea2a8af', 'id': '6d92dcbf-bdbb-4506-9c62-faa61f16b839', 'created_at': datetime.datetime(2026, 7, 9, 3, 22, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 3, 22, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d92dcbf-bdbb-4506-9c62-faa61f16b839/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fbfa28-b930-43ba-968c-c94db36ca9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:55 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Volume volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb (1f22dc56-9333-4226-8a2e-3ad5b132f2eb): created successfully Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fbfa28-b930-43ba-968c-c94db36ca9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Flow 'volume_create_manager' (35d75e3e-4de9-4edd-9aba-d604ad7d60c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:55 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3b371990-3b1e-476f-b9bf-909416439354 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Created volume successfully. Jul 09 05:22:55 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa" returned: 1 in 0.805s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:55 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa Jul 09 05:22:55 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "cinder-4763a337-5ef7-4bc3-9c75-40d429ea93f3-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Acquiring lock "cinder-1f22dc56-9333-4226-8a2e-3ad5b132f2eb-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-4763a337-5ef7-4bc3-9c75-40d429ea93f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "cinder-quobyte-cc5e3e85-5da6-473f-9a52-aac295a2607a" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Lock "cinder-1f22dc56-9333-4226-8a2e-3ad5b132f2eb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-cc5e3e85-5da6-473f-9a52-aac295a2607a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "cinder-quobyte-4763a337-5ef7-4bc3-9c75-40d429ea93f3" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:55 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c 1073741824" returned: 0 in 0.991s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-4763a337-5ef7-4bc3-9c75-40d429ea93f3" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Deleting offline snapshot 4763a337-5ef7-4bc3-9c75-40d429ea93f3 of volume cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] snapshot_file for this snap is: volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[58479c04-ff5d-43c8-9e59-656539d46a16]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Acquiring lock "cinder-quobyte-1f22dc56-9333-4226-8a2e-3ad5b132f2eb" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Lock "cinder-quobyte-1f22dc56-9333-4226-8a2e-3ad5b132f2eb" acquired by "delete_volume" :: waited 0.035s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:22:56 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c Jul 09 05:22:56 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c49e26-5be5-4aba-a744-1e1b1ed6104d]: (4, 'raw') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:56 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 Jul 09 05:22:56 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:56 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb Jul 09 05:22:56 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:56 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-10fe0467-d40e-49c6-b59e-0d01dd9e2daa" returned: 0 in 0.790s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Lock "cinder-quobyte-10fe0467-d40e-49c6-b59e-0d01dd9e2daa" released by "delete_volume" :: held 2.623s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Created reservations ['ea7db61b-d760-4207-a79f-183079620432', 'b6a60d71-ac4f-4560-b3c5-127a6b4cd79e', '5b1b6b2d-6195-468d-bd26-b0331f8e536a', '38d75101-9c2c-4a2b-9cad-0b1a9aad8612'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:56 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:22:56 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:56 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c" returned: 0 in 0.785s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb908e6e-e98b-4809-a8cc-3fade2ce3682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f59818b3-c831-4353-b316-b5b09e8d478c', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e6995f-4e08-49c9-80e1-1a9faaa3276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:22:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume volume-f59818b3-c831-4353-b316-b5b09e8d478c (f59818b3-c831-4353-b316-b5b09e8d478c): created successfully Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e6995f-4e08-49c9-80e1-1a9faaa3276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (d6a3a29c-0415-4d17-b9f9-58ff5787a2ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:22:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-18d0b8e8-e47e-4b26-8f92-83cc4756c0b0 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created volume successfully. Jul 09 05:22:56 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3" returned: 0 in 0.948s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc5e3e85-5da6-473f-9a52-aac295a2607a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:22:56 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb" returned: 0 in 0.873s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab139596-cb16-422e-8656-594eb054c19b]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:57 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb Jul 09 05:22:57 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:57 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a Jul 09 05:22:57 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:57 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.802s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:57 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:22:57 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Deleted volume successfully. Jul 09 05:22:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-27cf6e7d-143e-4407-9895-fc62873f5ca9 tempest-VolumeImageDependencyTests-1638955043 None] Lock "cinder-10fe0467-d40e-49c6-b59e-0d01dd9e2daa-delete_volume" released by "delete_volume" :: held 3.683s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:57 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb" returned: 1 in 0.808s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb' failed. Not Retrying. {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 05:22:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:57 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb Jul 09 05:22:57 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:57 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a" returned: 0 in 0.899s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:57 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 Jul 09 05:22:57 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Creating offline snapshot 9a9f3423-f850-49fb-a673-2bffa2b07f11 of volume f59818b3-c831-4353-b316-b5b09e8d478c {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b87eee-c956-4451-ac02-1d3ba227304e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:58 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c Jul 09 05:22:58 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:58 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-1f22dc56-9333-4226-8a2e-3ad5b132f2eb" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Lock "cinder-quobyte-1f22dc56-9333-4226-8a2e-3ad5b132f2eb" released by "delete_volume" :: held 2.557s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Created reservations ['1ff07dd9-4f01-4754-9452-d80fa47587e0', '124c6021-292b-4fa0-8259-ad43c1cb9cf6', '561f9b46-ae76-47fb-8a26-b187b73f910b', '908f9689-9c85-4595-890f-a26572a2d93f'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:58 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:22:58 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:58 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3" returned: 0 in 1.075s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:58 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3 Jul 09 05:22:58 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:59 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c" returned: 0 in 1.005s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:22:59 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 1G Jul 09 05:22:59 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:22:59 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.850s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:59 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:22:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Deleted volume successfully. Jul 09 05:22:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-eeb06c6f-dd3c-4931-b93f-ab97c1811617 tempest-VolumeAndVolumeTypeFromImageTest-1986469018 None] Lock "cinder-1f22dc56-9333-4226-8a2e-3ad5b132f2eb-delete_volume" released by "delete_volume" :: held 3.775s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:59 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 09 05:22:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a.4763a337-5ef7-4bc3-9c75-40d429ea93f3" returned: 0 in 0.826s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:22:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-4763a337-5ef7-4bc3-9c75-40d429ea93f3" released by "_delete_snapshot" :: held 3.883s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-cc5e3e85-5da6-473f-9a52-aac295a2607a" released by "delete_snapshot" :: held 3.928s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:22:59 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Created reservations ['aef46db7-0111-4dc6-a80e-7352f7d414f7', 'dba4109a-7dee-403b-b0b9-3c52258f7545', '8efeea10-d475-41ab-ad09-7095139c32a1', '4caf2ab5-17da-4f48-a9d2-a2587cb20492'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:00 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Delete snapshot completed successfully. Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-305119ff-4f45-4a95-adf1-ceca0ca9bef0 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-4763a337-5ef7-4bc3-9c75-40d429ea93f3-delete_snapshot" released by "delete_snapshot" :: held 4.147s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Acquiring lock "cinder-cc5e3e85-5da6-473f-9a52-aac295a2607a-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Lock "cinder-cc5e3e85-5da6-473f-9a52-aac295a2607a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Acquiring lock "cinder-quobyte-cc5e3e85-5da6-473f-9a52-aac295a2607a" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-cc5e3e85-5da6-473f-9a52-aac295a2607a" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[410c5875-d76b-4d33-976d-5d43ff6f27cf]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:00 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 1G" returned: 0 in 1.106s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f59818b3-c831-4353-b316-b5b09e8d478c -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:00 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f59818b3-c831-4353-b316-b5b09e8d478c -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 Jul 09 05:23:00 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:00 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a Jul 09 05:23:00 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:00 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Flow 'volume_create_manager' (31a191d5-138b-4000-99df-7c3b18c2f128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba0568c-bbb9-45c0-9cb1-f0f14d9cb1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba0568c-bbb9-45c0-9cb1-f0f14d9cb1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970d4af5-a070-45c3-9837-12183d224f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20da3f092de643e289d3a44d56be303e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:01Z,use_quota=True,user_id='ea4af891cbc14f64accca1f1c747220a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e4378e-8ab6-43bd-98f8-0f61087a4cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e4378e-8ab6-43bd-98f8-0f61087a4cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb62025a-02d9-41eb-aedf-cd50c623779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb62025a-02d9-41eb-aedf-cd50c623779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970d4af5-a070-45c3-9837-12183d224f59', 'volume_name': 'volume-970d4af5-a070-45c3-9837-12183d224f59', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e816fc-6d8c-4994-a981-8ee014794905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e816fc-6d8c-4994-a981-8ee014794905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6fe29e-d521-4d61-a35b-0098865fadf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:01 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Volume 970d4af5-a070-45c3-9837-12183d224f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970d4af5-a070-45c3-9837-12183d224f59', 'volume_size': 1} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:01 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a" returned: 0 in 0.917s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:01 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a Jul 09 05:23:01 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:01 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f59818b3-c831-4353-b316-b5b09e8d478c -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11" returned: 0 in 0.961s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:01 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 is being set with open permissions: ugo+rw Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:01 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 Jul 09 05:23:01 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:01 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-cc5e3e85-5da6-473f-9a52-aac295a2607a" returned: 0 in 0.731s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-cc5e3e85-5da6-473f-9a52-aac295a2607a" released by "delete_volume" :: held 1.719s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:02 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11" returned: 0 in 0.714s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Created reservations ['fa4c5ccd-65e0-450f-99c7-d00eb8e6b724', 'eb6a1cc8-8ace-45f6-b5d0-11799d7ccf43', '8e1aa96d-6448-4f6d-b88f-3a72953e2929', 'd1e1ffd7-4954-42d0-b8da-7c1ac35cd567'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:02 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.info Jul 09 05:23:02 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:02 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:02 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "cinder-8048fd4a-ec48-4778-b74d-03f8ec54d61b-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-8048fd4a-ec48-4778-b74d-03f8ec54d61b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "cinder-quobyte-8048fd4a-ec48-4778-b74d-03f8ec54d61b" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-8048fd4a-ec48-4778-b74d-03f8ec54d61b" acquired by "delete_volume" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8979201f-3123-4edd-a41d-e35e9e43565d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:02 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b Jul 09 05:23:02 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:02 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.info" returned: 0 in 0.768s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:02 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.info is being set with open permissions: ugo+rw Jul 09 05:23:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:02 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.info Jul 09 05:23:02 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:03 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.877s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Deleted volume successfully. Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ca2e47ca-ffef-43d1-a42b-ba3b8bcf20ab tempest-VolumeDependencyTests-9432178 None] Lock "cinder-cc5e3e85-5da6-473f-9a52-aac295a2607a-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:03 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b" returned: 0 in 0.951s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:03 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b Jul 09 05:23:03 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:03 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.info" returned: 0 in 0.806s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.501s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.634s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970d4af5-a070-45c3-9837-12183d224f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20da3f092de643e289d3a44d56be303e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:01Z,use_quota=True,user_id='ea4af891cbc14f64accca1f1c747220a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Creating volume 970d4af5-a070-45c3-9837-12183d224f59 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:03 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:03 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59 1073741824 Jul 09 05:23:03 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:03 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ad5eb5f4-6ad1-47c1-b017-94322a857283 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Create snapshot completed successfully Jul 09 05:23:04 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-8048fd4a-ec48-4778-b74d-03f8ec54d61b" returned: 0 in 0.705s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-quobyte-8048fd4a-ec48-4778-b74d-03f8ec54d61b" released by "delete_volume" :: held 1.710s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Created reservations ['9081cc26-fac2-44c3-af3f-c2cb9244bb60', 'ad4463ca-b1a8-452f-9678-eb899f04256b', '0d0d1b40-9689-4b60-9438-2ed41271ecac', '8208e342-c348-4803-8a59-4d0ec04f3208'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:04 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:04 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:04 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (5d32677d-6422-4b19-aa63-cb29ecb8eed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce96f1ae-6967-4e62-8eb3-b01c542e1f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59 1073741824" returned: 0 in 1.051s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce96f1ae-6967-4e62-8eb3-b01c542e1f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1523801601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2057332-ef57-4626-a310-3b343075d239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:05Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd97a92-a982-4fdc-89af-ff7663892c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd97a92-a982-4fdc-89af-ff7663892c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b914dfa6-391e-4149-b875-1aff28bfd6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b914dfa6-391e-4149-b875-1aff28bfd6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2057332-ef57-4626-a310-3b343075d239', 'volume_name': 'volume-b2057332-ef57-4626-a310-3b343075d239', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba20448e-6699-4455-aabf-b603134de353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba20448e-6699-4455-aabf-b603134de353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817f1f97-9679-418e-9c80-d2a1afe53d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:04 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume b2057332-ef57-4626-a310-3b343075d239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2057332-ef57-4626-a310-3b343075d239', 'volume_size': 1} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:04 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59 Jul 09 05:23:04 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (a0ffb9c1-fc36-4f5d-914f-0318526d41f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12932bf7-b7d9-4554-993e-42adfd0b7932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12932bf7-b7d9-4554-993e-42adfd0b7932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-638447868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83295f8-8c38-4613-984a-52504a351c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:05Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d153339-6579-41c4-8261-e535da5f30f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d153339-6579-41c4-8261-e535da5f30f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea96abd-e693-47c8-84e7-9da10f0b6115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea96abd-e693-47c8-84e7-9da10f0b6115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83295f8-8c38-4613-984a-52504a351c61', 'volume_name': 'volume-d83295f8-8c38-4613-984a-52504a351c61', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87af26a6-1e6b-40f4-93f6-da1cfc9680dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87af26a6-1e6b-40f4-93f6-da1cfc9680dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955f5633-2d0b-4c0a-bd25-ef30efd8daf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume d83295f8-8c38-4613-984a-52504a351c61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83295f8-8c38-4613-984a-52504a351c61', 'volume_size': 1} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:05 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.013s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:05 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Deleted volume successfully. Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4293f1d2-1e27-4c7f-8f82-b55fca4e0780 tempest-VolumeDependencyTests-9432178 None] Lock "cinder-8048fd4a-ec48-4778-b74d-03f8ec54d61b-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (646520a5-1ccf-4f03-8ac4-12e110efeedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e262dc2-2e0f-495c-a42a-251d0afcdeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e262dc2-2e0f-495c-a42a-251d0afcdeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-982638388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a23472-72da-48ac-850e-e574c676aaa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:06Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:05 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3362922f-b1d9-4294-8b3f-c4e8fbd6779e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3362922f-b1d9-4294-8b3f-c4e8fbd6779e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e23b87-32ef-47c5-b348-7bbedb7500fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e23b87-32ef-47c5-b348-7bbedb7500fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a23472-72da-48ac-850e-e574c676aaa4', 'volume_name': 'volume-73a23472-72da-48ac-850e-e574c676aaa4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2543236-f2cb-4b99-b5c0-8757a6df293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2543236-f2cb-4b99-b5c0-8757a6df293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c1e474-dbea-4e2d-b559-dcb24c089fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume 73a23472-72da-48ac-850e-e574c676aaa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a23472-72da-48ac-850e-e574c676aaa4', 'volume_size': 1} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59" returned: 0 in 0.903s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1523801601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2057332-ef57-4626-a310-3b343075d239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:05Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Creating volume b2057332-ef57-4626-a310-3b343075d239 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:05 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6fe29e-d521-4d61-a35b-0098865fadf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970d4af5-a070-45c3-9837-12183d224f59', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d061d0e-e80e-45ef-886b-7516a5cdccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:05 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239 1073741824 Jul 09 05:23:05 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:05 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Volume volume-970d4af5-a070-45c3-9837-12183d224f59 (970d4af5-a070-45c3-9837-12183d224f59): created successfully Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d061d0e-e80e-45ef-886b-7516a5cdccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:05 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Flow 'volume_create_manager' (31a191d5-138b-4000-99df-7c3b18c2f128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:05 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-42dd5457-dd81-4f49-8a41-ce545e844183 tempest-CinderUnicodeTest-783802347 None] Created volume successfully. Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (2d9a5532-6cc8-4505-9d68-bb4507a45d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309ae820-2d04-4fab-9347-f3460bca838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309ae820-2d04-4fab-9347-f3460bca838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039552561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983d56a8-9f25-478e-9a1a-911dd07da882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:06Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af648953-7d85-4a4e-af1a-3c5caccb5d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af648953-7d85-4a4e-af1a-3c5caccb5d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc193afb-703a-4f92-8fed-0990905e22d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc193afb-703a-4f92-8fed-0990905e22d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983d56a8-9f25-478e-9a1a-911dd07da882', 'volume_name': 'volume-983d56a8-9f25-478e-9a1a-911dd07da882', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffd443d-40aa-41cd-b4d3-0c639d9d69ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffd443d-40aa-41cd-b4d3-0c639d9d69ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac25efb0-3a47-413f-9f6f-687918da2b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:06 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume 983d56a8-9f25-478e-9a1a-911dd07da882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983d56a8-9f25-478e-9a1a-911dd07da882', 'volume_size': 1} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (2e6ae8d5-14fd-46a1-9628-6a48e4abb39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bae8a88-c01f-4247-ba87-1cc67be5dc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bae8a88-c01f-4247-ba87-1cc67be5dc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468012710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7213aa-3ee2-4926-a23c-04270c8f5db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:07Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e639ebc8-4776-4236-8f7a-64c831a32c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e639ebc8-4776-4236-8f7a-64c831a32c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7121bc78-3904-41ce-a485-59b6ddd6f3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7121bc78-3904-41ce-a485-59b6ddd6f3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f7213aa-3ee2-4926-a23c-04270c8f5db8', 'volume_name': 'volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d318814c-8b8d-47fa-a249-061c2873ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d318814c-8b8d-47fa-a249-061c2873ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28647794-8001-4c1b-95f5-6f51767f1190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:06 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume 0f7213aa-3ee2-4926-a23c-04270c8f5db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8', 'volume_size': 1} Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:06 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239 1073741824" returned: 0 in 1.117s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:07 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239 Jul 09 05:23:07 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Flow 'volume_create_manager' (e30f125c-a7fa-4d73-8d13-318f9c31e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9613ce3f-c49c-40d7-85b8-604f8463d87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9613ce3f-c49c-40d7-85b8-604f8463d87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1414028475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26498a2-1de6-487c-8bdf-69afab1c7ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20da3f092de643e289d3a44d56be303e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:07Z,use_quota=True,user_id='ea4af891cbc14f64accca1f1c747220a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bfd7d2-e698-4340-b6f7-07172d73888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bfd7d2-e698-4340-b6f7-07172d73888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b778a08-4242-46cb-a3a8-dfcb26964662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b778a08-4242-46cb-a3a8-dfcb26964662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26498a2-1de6-487c-8bdf-69afab1c7ef4', 'volume_name': 'volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46eedf44-9df8-4a2e-a42e-1b530de74d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46eedf44-9df8-4a2e-a42e-1b530de74d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1de5fe-4fac-41e5-8ff1-6698c0c38f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Volume a26498a2-1de6-487c-8bdf-69afab1c7ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4', 'volume_size': 1} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (89271485-142c-4eac-a038-2a6c8bbf1a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b318db-6afb-4dff-b0a0-0f60fc5c9b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b318db-6afb-4dff-b0a0-0f60fc5c9b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-427209566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff46664-d898-4dfb-bd70-5fa116b42a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:07Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3882854b-2d47-4889-8b00-f5cfa3c22c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3882854b-2d47-4889-8b00-f5cfa3c22c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e99dac4-f3b6-4501-95a0-5cdeddfe645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e99dac4-f3b6-4501-95a0-5cdeddfe645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff46664-d898-4dfb-bd70-5fa116b42a08', 'volume_name': 'volume-9ff46664-d898-4dfb-bd70-5fa116b42a08', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419dca4a-8594-4e15-9d90-05772579be26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419dca4a-8594-4e15-9d90-05772579be26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b89d6d-5598-41a6-9018-5b60b2c2aac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume 9ff46664-d898-4dfb-bd70-5fa116b42a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff46664-d898-4dfb-bd70-5fa116b42a08', 'volume_size': 1} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:07 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239" returned: 0 in 0.712s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.390s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-638447868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83295f8-8c38-4613-984a-52504a351c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:05Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Creating volume d83295f8-8c38-4613-984a-52504a351c61 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:07 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:07 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61 1073741824 Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817f1f97-9679-418e-9c80-d2a1afe53d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2057332-ef57-4626-a310-3b343075d239', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:07 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488d1793-3663-469b-93ef-0be9259c0953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:07 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume volume-b2057332-ef57-4626-a310-3b343075d239 (b2057332-ef57-4626-a310-3b343075d239): created successfully Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488d1793-3663-469b-93ef-0be9259c0953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (5d32677d-6422-4b19-aa63-cb29ecb8eed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b398d695-d08c-4d9a-889a-a52349e4e018 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created volume successfully. Jul 09 05:23:08 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61 1073741824" returned: 0 in 0.932s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (5cc32f50-5b9f-4497-820b-acca34a5610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39e5a86-64ba-4a11-ab4b-242b171e4ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39e5a86-64ba-4a11-ab4b-242b171e4ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491547173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279d5265-4ca7-4e70-87cd-d53a7e701ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:09Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a415bb18-4f51-4c46-b953-c034b63a799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a415bb18-4f51-4c46-b953-c034b63a799d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf5ecaa-11f8-4681-8a16-c79b1cc91ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf5ecaa-11f8-4681-8a16-c79b1cc91ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279d5265-4ca7-4e70-87cd-d53a7e701ca1', 'volume_name': 'volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0532cc42-7333-46a7-8057-04ab5bffb081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0532cc42-7333-46a7-8057-04ab5bffb081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e42e2e-1aa6-4181-9095-517ec63f168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:08 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume 279d5265-4ca7-4e70-87cd-d53a7e701ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1', 'volume_size': 1} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:08 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61 Jul 09 05:23:08 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (dfad304c-6f56-48b9-861e-98304e687d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ef0ddc-9c6b-4e40-9719-ecdc1a0a1ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ef0ddc-9c6b-4e40-9719-ecdc1a0a1ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-354867575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd23b779-1d24-46a3-937f-3acc9b55a4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:09Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fb141f-9cd9-4abd-99c3-b3f9fc1a1e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fb141f-9cd9-4abd-99c3-b3f9fc1a1e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321cae47-06b8-4ded-9224-761a138fa198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321cae47-06b8-4ded-9224-761a138fa198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd23b779-1d24-46a3-937f-3acc9b55a4c8', 'volume_name': 'volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30825edf-edf9-4530-8dc9-f879c4cce8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30825edf-edf9-4530-8dc9-f879c4cce8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30538f3a-5087-4ce8-92e4-8cd2d2533bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume fd23b779-1d24-46a3-937f-3acc9b55a4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8', 'volume_size': 1} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:09 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61" returned: 0 in 0.826s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.819s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-982638388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a23472-72da-48ac-850e-e574c676aaa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:06Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Creating volume 73a23472-72da-48ac-850e-e574c676aaa4 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:09 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955f5633-2d0b-4c0a-bd25-ef30efd8daf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83295f8-8c38-4613-984a-52504a351c61', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf71bdfb-10b3-48a0-b5f9-fa9683999af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4 1073741824 Jul 09 05:23:09 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (0a159214-6423-47f9-8fd2-0c2444668e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3742977-ade3-4e18-b8b6-c6a0da28540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume volume-d83295f8-8c38-4613-984a-52504a351c61 (d83295f8-8c38-4613-984a-52504a351c61): created successfully Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf71bdfb-10b3-48a0-b5f9-fa9683999af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (a0ffb9c1-fc36-4f5d-914f-0318526d41f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3742977-ade3-4e18-b8b6-c6a0da28540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1884756716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22500e1a-c943-46e2-b0f1-a8c51208d55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:10Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f7628f-070f-4687-bbcf-7066823d6556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f7628f-070f-4687-bbcf-7066823d6556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c9b19f-2a6b-4298-8529-29b1ebe956ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c9b19f-2a6b-4298-8529-29b1ebe956ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22500e1a-c943-46e2-b0f1-a8c51208d55e', 'volume_name': 'volume-22500e1a-c943-46e2-b0f1-a8c51208d55e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9c69e2-1efc-4422-b82c-66e63184cd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9c69e2-1efc-4422-b82c-66e63184cd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78896ed-9822-468e-a075-bc16ac65cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:09 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume 22500e1a-c943-46e2-b0f1-a8c51208d55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22500e1a-c943-46e2-b0f1-a8c51208d55e', 'volume_size': 1} Jul 09 05:23:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-accb71df-ec83-41af-ab8e-7bd2313dd894 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created volume successfully. Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (8d3c72b8-42f7-4970-8724-c3ba1178c70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2063c9-8851-4878-9763-c6941cc96510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2063c9-8851-4878-9763-c6941cc96510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960959066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b5b7a2-6eda-4efb-aae7-9682084ff7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:10Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305aff25-8fb0-4750-95d2-e6fe3c598071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305aff25-8fb0-4750-95d2-e6fe3c598071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a545a6c5-ca0c-401a-954d-1401ddb52c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a545a6c5-ca0c-401a-954d-1401ddb52c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b5b7a2-6eda-4efb-aae7-9682084ff7ed', 'volume_name': 'volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b02fe3-1356-407e-85a2-d13785b683d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b02fe3-1356-407e-85a2-d13785b683d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490e1136-b841-4843-a41c-e87c93cdf7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:10 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume a5b5b7a2-6eda-4efb-aae7-9682084ff7ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed', 'volume_size': 1} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (a92172ef-8be5-4bc6-9950-20082a326c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129b1988-246c-4078-9d2c-b8dff22c46d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129b1988-246c-4078-9d2c-b8dff22c46d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-166442819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f599bcb7-5acf-4efa-bdea-5d85bbeea7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:10Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbec4d19-765a-4e87-b125-8dd4e1f4ef73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbec4d19-765a-4e87-b125-8dd4e1f4ef73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba12fb93-bd32-4f5b-b7e4-98c3ffe9a1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba12fb93-bd32-4f5b-b7e4-98c3ffe9a1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f599bcb7-5acf-4efa-bdea-5d85bbeea7e2', 'volume_name': 'volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a493192-5405-45ba-8750-683eb736d166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a493192-5405-45ba-8750-683eb736d166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7d2ec0-3726-425c-a967-999409d9a12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:10 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume f599bcb7-5acf-4efa-bdea-5d85bbeea7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2', 'volume_size': 1} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:10 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4 1073741824" returned: 0 in 0.998s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:10 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4 Jul 09 05:23:10 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:11 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4" returned: 0 in 0.751s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.150s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039552561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983d56a8-9f25-478e-9a1a-911dd07da882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:06Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Creating volume 983d56a8-9f25-478e-9a1a-911dd07da882 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:11 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c1e474-dbea-4e2d-b559-dcb24c089fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a23472-72da-48ac-850e-e574c676aaa4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:11 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882 1073741824 Jul 09 05:23:11 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ff5e35-d366-4046-b94d-0039e7781745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume volume-73a23472-72da-48ac-850e-e574c676aaa4 (73a23472-72da-48ac-850e-e574c676aaa4): created successfully Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ff5e35-d366-4046-b94d-0039e7781745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (646520a5-1ccf-4f03-8ac4-12e110efeedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9c82b777-4ae2-4b72-b1d7-7c686718835b tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created volume successfully. Jul 09 05:23:12 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882 1073741824" returned: 0 in 0.899s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:12 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882 Jul 09 05:23:12 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:13 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882" returned: 0 in 0.706s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.429s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468012710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7213aa-3ee2-4926-a23c-04270c8f5db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:07Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Creating volume 0f7213aa-3ee2-4926-a23c-04270c8f5db8 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:13 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:13 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8 1073741824 Jul 09 05:23:13 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac25efb0-3a47-413f-9f6f-687918da2b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983d56a8-9f25-478e-9a1a-911dd07da882', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780aa320-2bdf-47cd-8cbf-6821fccd8043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:13 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume volume-983d56a8-9f25-478e-9a1a-911dd07da882 (983d56a8-9f25-478e-9a1a-911dd07da882): created successfully Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780aa320-2bdf-47cd-8cbf-6821fccd8043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:13 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (2d9a5532-6cc8-4505-9d68-bb4507a45d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-604b6f31-2fd7-48ea-bab2-614ab6f67b7d tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created volume successfully. Jul 09 05:23:14 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8 1073741824" returned: 0 in 0.896s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:14 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8 Jul 09 05:23:14 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (0ad95881-bbb1-4187-b807-c39508aebaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fc33b8-cb38-4ae2-a756-6aaf85950609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fc33b8-cb38-4ae2-a756-6aaf85950609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329745208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92b8d8b-75c6-4c38-a3b3-fc0414338613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:15Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c48d39d-637a-4e46-a604-113bbe982bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c48d39d-637a-4e46-a604-113bbe982bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfd1150-f06f-469a-abc9-f07036a9ce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfd1150-f06f-469a-abc9-f07036a9ce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f92b8d8b-75c6-4c38-a3b3-fc0414338613', 'volume_name': 'volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee0b601-9a2f-4288-b6a8-97443cad4e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee0b601-9a2f-4288-b6a8-97443cad4e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04e0e67-67e2-48d9-bf38-7d96c1908d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:14 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Volume f92b8d8b-75c6-4c38-a3b3-fc0414338613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613', 'volume_size': 1} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:14 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8" returned: 0 in 0.718s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.241s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1414028475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26498a2-1de6-487c-8bdf-69afab1c7ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20da3f092de643e289d3a44d56be303e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:07Z,use_quota=True,user_id='ea4af891cbc14f64accca1f1c747220a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Creating volume a26498a2-1de6-487c-8bdf-69afab1c7ef4 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:14 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28647794-8001-4c1b-95f5-6f51767f1190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47dd340d-f381-4046-8ec2-a95bd23bf74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:14 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 1073741824 Jul 09 05:23:14 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:14 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8 (0f7213aa-3ee2-4926-a23c-04270c8f5db8): created successfully Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47dd340d-f381-4046-8ec2-a95bd23bf74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (2e6ae8d5-14fd-46a1-9628-6a48e4abb39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:14 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ad738862-c988-440b-b713-0e5341590de3 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created volume successfully. Jul 09 05:23:15 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 1073741824" returned: 0 in 0.837s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:15 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 Jul 09 05:23:15 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:16 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4" returned: 0 in 0.673s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.715s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-427209566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff46664-d898-4dfb-bd70-5fa116b42a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b022a9ba67547849b272f743371c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:07Z,use_quota=True,user_id='8805017a15d44226a38894fa32ba1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Creating volume 9ff46664-d898-4dfb-bd70-5fa116b42a08 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:16 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1de5fe-4fac-41e5-8ff1-6698c0c38f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:16 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08 1073741824 Jul 09 05:23:16 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683321a2-4f52-4342-bed6-cd3f928a654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:16 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Volume volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 (a26498a2-1de6-487c-8bdf-69afab1c7ef4): created successfully Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683321a2-4f52-4342-bed6-cd3f928a654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:16 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Flow 'volume_create_manager' (e30f125c-a7fa-4d73-8d13-318f9c31e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-92e7faa7-1a8e-49db-836e-c3f7ff218469 tempest-CinderUnicodeTest-783802347 None] Created volume successfully. Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:17 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08 1073741824" returned: 0 in 0.867s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:17 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08 Jul 09 05:23:17 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:17 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08" returned: 0 in 0.665s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.119s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491547173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279d5265-4ca7-4e70-87cd-d53a7e701ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:09Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Creating volume 279d5265-4ca7-4e70-87cd-d53a7e701ca1 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:17 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:17 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1 1073741824 Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b89d6d-5598-41a6-9018-5b60b2c2aac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff46664-d898-4dfb-bd70-5fa116b42a08', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:17 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44865b6-0cf7-4bba-801a-92b1010733b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:17 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Volume volume-9ff46664-d898-4dfb-bd70-5fa116b42a08 (9ff46664-d898-4dfb-bd70-5fa116b42a08): created successfully Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44865b6-0cf7-4bba-801a-92b1010733b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:17 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Flow 'volume_create_manager' (89271485-142c-4eac-a038-2a6c8bbf1a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:18 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a32ad13b-0880-4adc-b11c-ca1dfd2e94a7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created volume successfully. Jul 09 05:23:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-9ff46664-d898-4dfb-bd70-5fa116b42a08-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-9ff46664-d898-4dfb-bd70-5fa116b42a08-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-quobyte-9ff46664-d898-4dfb-bd70-5fa116b42a08" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:18 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-9ff46664-d898-4dfb-bd70-5fa116b42a08" acquired by "delete_volume" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:18 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[83161f3b-72e6-41fe-b127-8e0fd373e7e3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:18 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08 Jul 09 05:23:18 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:18 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1 1073741824" returned: 0 in 0.908s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:18 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1 Jul 09 05:23:18 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:19 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08" returned: 0 in 0.793s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:19 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08 Jul 09 05:23:19 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:19 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1" returned: 0 in 0.716s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.305s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-354867575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd23b779-1d24-46a3-937f-3acc9b55a4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:09Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Creating volume fd23b779-1d24-46a3-937f-3acc9b55a4c8 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:19 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e42e2e-1aa6-4181-9095-517ec63f168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:19 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8 1073741824 Jul 09 05:23:19 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661ffebc-4067-411e-a1f1-595e9404d1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:19 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1 (279d5265-4ca7-4e70-87cd-d53a7e701ca1): created successfully Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661ffebc-4067-411e-a1f1-595e9404d1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (5cc32f50-5b9f-4497-820b-acca34a5610a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:19 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-487095f1-33ae-4379-bbc4-161a2a442102 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created volume successfully. Jul 09 05:23:19 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9ff46664-d898-4dfb-bd70-5fa116b42a08" returned: 0 in 0.741s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-9ff46664-d898-4dfb-bd70-5fa116b42a08" released by "delete_volume" :: held 1.581s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:19 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created reservations ['ec205295-4284-43a3-9852-ab82e18556e0', '9c880ecc-94c9-4c7d-8c8f-72ecbe738bf3', '6b85ea7e-1939-4458-8000-31a51a4a515c', '1e06339a-cbd5-4c42-b353-6372bc081fc5'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:20 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:20 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:20 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8 1073741824" returned: 0 in 0.847s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-0f7213aa-3ee2-4926-a23c-04270c8f5db8-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-0f7213aa-3ee2-4926-a23c-04270c8f5db8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:20 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8 Jul 09 05:23:20 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-quobyte-0f7213aa-3ee2-4926-a23c-04270c8f5db8" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-0f7213aa-3ee2-4926-a23c-04270c8f5db8" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f3c17c-df59-4102-89b8-ecdb6e1ff1d6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:20 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8 Jul 09 05:23:20 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:20 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.697s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:20 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Deleted volume successfully. Jul 09 05:23:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-8fdbca41-9b89-4770-a7ae-ec80b055181e tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-9ff46664-d898-4dfb-bd70-5fa116b42a08-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:21 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8" returned: 0 in 0.675s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.403s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1884756716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22500e1a-c943-46e2-b0f1-a8c51208d55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:10Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Creating volume 22500e1a-c943-46e2-b0f1-a8c51208d55e {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:21 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30538f3a-5087-4ce8-92e4-8cd2d2533bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:21 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e 1073741824 Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd0fb0a-73cf-467b-b75f-5bf078620d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:21 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:21 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8 (fd23b779-1d24-46a3-937f-3acc9b55a4c8): created successfully Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd0fb0a-73cf-467b-b75f-5bf078620d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (dfad304c-6f56-48b9-861e-98304e687d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5962b8cd-b9dd-4f95-91e6-4162678cce72 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created volume successfully. Jul 09 05:23:21 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8" returned: 0 in 0.838s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:21 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8 Jul 09 05:23:21 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:22 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e 1073741824" returned: 0 in 0.906s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:22 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-0f7213aa-3ee2-4926-a23c-04270c8f5db8" returned: 0 in 0.692s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-0f7213aa-3ee2-4926-a23c-04270c8f5db8" released by "delete_volume" :: held 1.577s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:22 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e Jul 09 05:23:22 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created reservations ['ec59edb1-2e60-449d-81dc-f0ee1962a97c', '0711fe21-1696-4ed1-bea9-a61c082faae9', '72179f4d-d1e5-4025-99f4-a8695b4a813c', 'c168a475-1c57-46fd-912e-3bdda67c50fb'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:22 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:22 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-983d56a8-9f25-478e-9a1a-911dd07da882-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-983d56a8-9f25-478e-9a1a-911dd07da882-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-quobyte-983d56a8-9f25-478e-9a1a-911dd07da882" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-983d56a8-9f25-478e-9a1a-911dd07da882" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c61acb-994d-4162-a3d6-0d1c39f6cc85]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:22 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e" returned: 0 in 0.671s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.728s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960959066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b5b7a2-6eda-4efb-aae7-9682084ff7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:10Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Creating volume a5b5b7a2-6eda-4efb-aae7-9682084ff7ed {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:22 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=121,cinder:UPDATE=159,cinder:DELETE=19,cinder:INSERT=47 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:23:22 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed 1073741824 Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78896ed-9822-468e-a075-bc16ac65cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22500e1a-c943-46e2-b0f1-a8c51208d55e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:22 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cb0a5b-5671-48ad-af94-761f2fbd73f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:22 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume volume-22500e1a-c943-46e2-b0f1-a8c51208d55e (22500e1a-c943-46e2-b0f1-a8c51208d55e): created successfully Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cb0a5b-5671-48ad-af94-761f2fbd73f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:22 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (0a159214-6423-47f9-8fd2-0c2444668e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:22 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882 Jul 09 05:23:22 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:22 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-697cc40c-2f1d-41f0-a3b6-1921c0577553 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created volume successfully. Jul 09 05:23:23 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.726s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:23 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:23 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Deleted volume successfully. Jul 09 05:23:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1f2037a6-d05d-476a-bc03-2baa72acc632 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-0f7213aa-3ee2-4926-a23c-04270c8f5db8-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:23 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882" returned: 0 in 0.842s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:23 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882 Jul 09 05:23:23 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:23 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed 1073741824" returned: 0 in 0.914s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:23 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=171,cinder:SELECT=132,cinder:INSERT=42,cinder:DELETE=14 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:23:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:23 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed Jul 09 05:23:23 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:24 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-983d56a8-9f25-478e-9a1a-911dd07da882" returned: 0 in 0.697s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-983d56a8-9f25-478e-9a1a-911dd07da882" released by "delete_volume" :: held 1.579s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created reservations ['7261802e-1d77-430a-b9cc-f94cb3b760b5', '34fabfb0-215a-45af-92f1-6fd4f80fd185', '85af039b-efe4-4724-b817-978d20e1efd1', 'cd72f12a-d860-4da8-b7c9-897320da352d'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:24 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed" returned: 0 in 0.698s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:24 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:24 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.999s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-166442819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f599bcb7-5acf-4efa-bdea-5d85bbeea7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d1ab9386247e48a71c35343f6cde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:10Z,use_quota=True,user_id='7f4736d64fe646b39428d2d2e13cb6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Creating volume f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:24 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490e1136-b841-4843-a41c-e87c93cdf7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:24 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 1073741824 Jul 09 05:23:24 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8c7cb9-7ef4-4186-8d1c-051e80355f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:24 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed (a5b5b7a2-6eda-4efb-aae7-9682084ff7ed): created successfully Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8c7cb9-7ef4-4186-8d1c-051e80355f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (8d3c72b8-42f7-4970-8724-c3ba1178c70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:24 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0b8a7ad3-a2bb-4e68-b553-c8acc8c181a5 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created volume successfully. Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-73a23472-72da-48ac-850e-e574c676aaa4-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-73a23472-72da-48ac-850e-e574c676aaa4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-quobyte-73a23472-72da-48ac-850e-e574c676aaa4" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-73a23472-72da-48ac-850e-e574c676aaa4" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b60458-0669-4124-9420-3d1a16305e87]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:25 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.724s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:25 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Deleted volume successfully. Jul 09 05:23:25 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4 Jul 09 05:23:25 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-34e93956-da05-4940-b591-8a56f8c865d7 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-983d56a8-9f25-478e-9a1a-911dd07da882-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:25 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 1073741824" returned: 0 in 0.942s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:25 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 Jul 09 05:23:25 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:25 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4" returned: 0 in 0.819s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:25 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4 Jul 09 05:23:25 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:26 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2" returned: 0 in 0.687s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.516s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329745208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92b8d8b-75c6-4c38-a3b3-fc0414338613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:15Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Creating volume f92b8d8b-75c6-4c38-a3b3-fc0414338613 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:26 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7d2ec0-3726-425c-a967-999409d9a12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:26 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 1073741824 Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f6d51f-8016-4d69-ab19-7be2d06de5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:26 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:26 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Volume volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 (f599bcb7-5acf-4efa-bdea-5d85bbeea7e2): created successfully Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f6d51f-8016-4d69-ab19-7be2d06de5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Flow 'volume_create_manager' (a92172ef-8be5-4bc6-9950-20082a326c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:26 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5694c03c-4bc3-46cb-80c2-45e74f142c75 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created volume successfully. Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:26 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-73a23472-72da-48ac-850e-e574c676aaa4" returned: 0 in 0.735s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-73a23472-72da-48ac-850e-e574c676aaa4" released by "delete_volume" :: held 1.611s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-quobyte-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8389a7c-8cc9-4988-8c14-cbbd0529cc26]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created reservations ['8689c9c0-21c4-4a90-954e-1f48bf251a4c', '9ee2d181-a850-48b5-864d-6aa028d4a31d', '1b6af6fd-6e62-41b4-a067-c3597a0ad699', '6d50459d-b270-4c14-bd3b-ab0390d863ac'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:26 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 Jul 09 05:23:26 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:26 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:26 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:27 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 1073741824" returned: 0 in 0.936s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:27 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 Jul 09 05:23:27 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-d83295f8-8c38-4613-984a-52504a351c61-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-d83295f8-8c38-4613-984a-52504a351c61-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-quobyte-d83295f8-8c38-4613-984a-52504a351c61" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-d83295f8-8c38-4613-984a-52504a351c61" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a473aad2-82da-4f61-99dd-c20895791082]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:27 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.752s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:27 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Deleted volume successfully. Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-071bdd4a-77f9-4c02-996e-777ac4d4f065 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-73a23472-72da-48ac-850e-e574c676aaa4-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:27 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61 Jul 09 05:23:27 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:27 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2" returned: 0 in 0.953s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:27 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2 Jul 09 05:23:27 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:28 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613" returned: 0 in 0.875s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.082s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Creating offline snapshot 0f59fc90-65c9-42f3-8a6c-bc237bdffd38 of volume a26498a2-1de6-487c-8bdf-69afab1c7ef4 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04e0e67-67e2-48d9-bf38-7d96c1908d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2807aed1-e0e2-4794-a7c2-893a371941dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e600537-181d-4cd8-ac5c-f547e3ef3206]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:28 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Volume volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 (f92b8d8b-75c6-4c38-a3b3-fc0414338613): created successfully Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2807aed1-e0e2-4794-a7c2-893a371941dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (0ad95881-bbb1-4187-b807-c39508aebaf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:28 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-20445ac3-b0e0-4eaf-8b2c-47ab347dbe93 tempest-ProjectMemberTests-1563098389 None] Created volume successfully. Jul 09 05:23:28 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 Jul 09 05:23:28 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:28 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2" returned: 0 in 0.747s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2" released by "delete_volume" :: held 1.759s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:28 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61" returned: 0 in 1.062s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:28 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61 Jul 09 05:23:28 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created reservations ['19f4e1b7-a9bc-413e-a8d6-f5dddb74705e', 'e6afa577-bfd3-4215-b7f9-53c17fbef8d1', '10b97c6c-fee0-4b21-8958-d781ae9e1fb5', '1712cae5-a1e0-4db0-ac71-58a176153c4f'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:28 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:28 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:28 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:29 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-quobyte-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4" returned: 0 in 0.927s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed" acquired by "delete_volume" :: waited 0.048s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:29 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 1G Jul 09 05:23:29 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8f47bd-bcd8-4952-a5da-3f72725f5940]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:29 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed Jul 09 05:23:29 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:29 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d83295f8-8c38-4613-984a-52504a351c61" returned: 0 in 0.824s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-d83295f8-8c38-4613-984a-52504a351c61" released by "delete_volume" :: held 1.944s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created reservations ['14df68a4-8866-417b-a7da-78d851d5615e', '3b1f54ab-da45-4005-bc9b-0d9cf5da7c31', 'eb317730-9c8f-4d5f-baa0-a8022fab8cc3', 'c8e5fde7-d12d-42d8-9f9d-e5ef66bb16bf'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:29 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.805s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:29 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Deleted volume successfully. Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-fbdb72fe-e5cc-4132-8ccb-29a444605b9e tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-f599bcb7-5acf-4efa-bdea-5d85bbeea7e2-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:29 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:29 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-9a9f3423-f850-49fb-a673-2bffa2b07f11-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-9a9f3423-f850-49fb-a673-2bffa2b07f11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-quobyte-f59818b3-c831-4353-b316-b5b09e8d478c" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-f59818b3-c831-4353-b316-b5b09e8d478c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-quobyte-9a9f3423-f850-49fb-a673-2bffa2b07f11" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-9a9f3423-f850-49fb-a673-2bffa2b07f11" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Deleting offline snapshot 9a9f3423-f850-49fb-a673-2bffa2b07f11 of volume f59818b3-c831-4353-b316-b5b09e8d478c {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] snapshot_file for this snap is: volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b285026b-6154-42be-9b8f-27036d409a5f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:29 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 Jul 09 05:23:29 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:30 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:30 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed" returned: 0 in 0.946s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 1G" returned: 0 in 1.031s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:30 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed Jul 09 05:23:30 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:30 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 Jul 09 05:23:30 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:30 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.740s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:30 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Deleted volume successfully. Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e8c8f240-0660-487c-8b69-02a982ea4715 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-d83295f8-8c38-4613-984a-52504a351c61-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:30 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11" returned: 0 in 0.850s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f59818b3-c831-4353-b316-b5b09e8d478c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e3d0f4-5ec5-430f-ada4-1948e6c3ea62]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:30 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c Jul 09 05:23:30 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:30 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed" returned: 0 in 0.700s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed" released by "delete_volume" :: held 1.698s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created reservations ['e69bf944-bdc2-4bdf-82e9-576a92bcfc19', '2c8d89f2-6c8f-40e0-add7-9d17ab6e63d2', '2b4617ab-d4e2-4f60-a767-6767617f23fd', '52a7bda8-079d-4884-b332-9246d73c031e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:30 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38" returned: 0 in 0.780s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:30 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 is being set with open permissions: ugo+rw Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:30 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 Jul 09 05:23:30 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:31 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:31 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-22500e1a-c943-46e2-b0f1-a8c51208d55e-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-22500e1a-c943-46e2-b0f1-a8c51208d55e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-quobyte-22500e1a-c943-46e2-b0f1-a8c51208d55e" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-22500e1a-c943-46e2-b0f1-a8c51208d55e" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bbcbfd-d1f0-4cab-a0ba-e0e16df39001]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:31 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c" returned: 0 in 0.884s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:31 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e Jul 09 05:23:31 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 Jul 09 05:23:31 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:31 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:31 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38" returned: 0 in 0.705s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:31 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.info Jul 09 05:23:31 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:31 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.730s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Deleted volume successfully. Jul 09 05:23:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6009043c-3f90-40e1-8e75-4b2c7f262b10 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-a5b5b7a2-6eda-4efb-aae7-9682084ff7ed-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:32 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e" returned: 0 in 0.853s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:32 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e Jul 09 05:23:32 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:32 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:32 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.info" returned: 0 in 0.698s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:32 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.info is being set with open permissions: ugo+rw Jul 09 05:23:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11" returned: 0 in 0.823s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:32 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.info Jul 09 05:23:32 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:32 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11 Jul 09 05:23:32 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:32 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:32 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-22500e1a-c943-46e2-b0f1-a8c51208d55e" returned: 0 in 0.700s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.info" returned: 0 in 0.643s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.916s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-22500e1a-c943-46e2-b0f1-a8c51208d55e" released by "delete_volume" :: held 1.622s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.110s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Creating offline snapshot 7211647c-353f-4091-9959-070d0c35c682 of volume f92b8d8b-75c6-4c38-a3b3-fc0414338613 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:23:33 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c.9a9f3423-f850-49fb-a673-2bffa2b07f11" returned: 0 in 0.703s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e2510b-78e7-4002-b296-921336845f82]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c30408d9-8591-47af-a315-e25e3ea44633 tempest-CinderUnicodeTest-783802347 None] Create snapshot completed successfully Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-9a9f3423-f850-49fb-a673-2bffa2b07f11" released by "_delete_snapshot" :: held 3.389s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-f59818b3-c831-4353-b316-b5b09e8d478c" released by "delete_snapshot" :: held 3.421s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created reservations ['a59a9981-56e9-4db3-9727-d281d64bdc3f', '73b0cd7a-47b7-44c2-8d54-39cb7ec316ac', '04310743-eee6-48d6-a398-6e8931874563', 'f2927bdb-2910-4d5a-bebf-5104a27d01cd'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:33 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 Jul 09 05:23:33 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created reservations ['786df996-d802-4240-b6cb-27f78c6eb240', 'aa461f43-f3c1-4c5d-a3b2-b4a4acf8e52b', '9729b89a-83ea-40f7-8c37-bbda56bf64d5', '1b42734a-b2fc-4932-90b9-bc4489db8eaf'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:33 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:33 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Delete snapshot completed successfully. Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-496eea01-bf17-43db-ba32-055f85fa7314 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-9a9f3423-f850-49fb-a673-2bffa2b07f11-delete_snapshot" released by "delete_snapshot" :: held 3.638s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-fd23b779-1d24-46a3-937f-3acc9b55a4c8-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-fd23b779-1d24-46a3-937f-3acc9b55a4c8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-quobyte-fd23b779-1d24-46a3-937f-3acc9b55a4c8" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-fd23b779-1d24-46a3-937f-3acc9b55a4c8" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3454238c-4920-4272-8609-d645dbbb28c6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:33 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8 Jul 09 05:23:33 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "cinder-0f59fc90-65c9-42f3-8a6c-bc237bdffd38-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Lock "cinder-0f59fc90-65c9-42f3-8a6c-bc237bdffd38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "cinder-quobyte-a26498a2-1de6-487c-8bdf-69afab1c7ef4" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Lock "cinder-quobyte-a26498a2-1de6-487c-8bdf-69afab1c7ef4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "cinder-quobyte-0f59fc90-65c9-42f3-8a6c-bc237bdffd38" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Lock "cinder-quobyte-0f59fc90-65c9-42f3-8a6c-bc237bdffd38" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Deleting offline snapshot 0f59fc90-65c9-42f3-8a6c-bc237bdffd38 of volume a26498a2-1de6-487c-8bdf-69afab1c7ef4 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] snapshot_file for this snap is: volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7442d9-c0a6-4f34-a30c-fd605cb71a94]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:33 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.727s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:33 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-f59818b3-c831-4353-b316-b5b09e8d478c-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:34 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Deleted volume successfully. Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-f59818b3-c831-4353-b316-b5b09e8d478c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:34 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 Jul 09 05:23:34 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-65b93e8a-4890-45ab-af58-46ac7cd1b611 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-22500e1a-c943-46e2-b0f1-a8c51208d55e-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "cinder-quobyte-f59818b3-c831-4353-b316-b5b09e8d478c" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:34 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613" returned: 0 in 1.082s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-f59818b3-c831-4353-b316-b5b09e8d478c" acquired by "delete_volume" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:34 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 1G Jul 09 05:23:34 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[85704aec-7e2d-46fd-890d-08be9563b361]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:34 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c Jul 09 05:23:34 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:34 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8" returned: 0 in 0.872s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:34 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8 Jul 09 05:23:34 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:34 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38" returned: 0 in 0.830s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b56dc4-68e2-45c1-a5d6-091c4d417a96]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:34 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 Jul 09 05:23:34 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:35 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c" returned: 0 in 0.894s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:35 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c Jul 09 05:23:35 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:35 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 1G" returned: 0 in 1.040s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:35 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 Jul 09 05:23:35 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:35 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fd23b779-1d24-46a3-937f-3acc9b55a4c8" returned: 0 in 0.842s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-fd23b779-1d24-46a3-937f-3acc9b55a4c8" released by "delete_volume" :: held 1.767s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created reservations ['1afaae29-2d06-435f-b3b8-259a42c44775', '3968eaac-b0b9-4843-a140-70a79d4bd333', '4adc62b8-acdd-4363-ae53-11062c610ebb', '26371088-1db4-4d7b-b1a9-d90a85976a7b'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:35 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:35 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:35 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4" returned: 0 in 0.903s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:35 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 Jul 09 05:23:35 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-279d5265-4ca7-4e70-87cd-d53a7e701ca1-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:35 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f59818b3-c831-4353-b316-b5b09e8d478c" returned: 0 in 0.815s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-279d5265-4ca7-4e70-87cd-d53a7e701ca1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-quobyte-f59818b3-c831-4353-b316-b5b09e8d478c" released by "delete_volume" :: held 1.811s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-quobyte-279d5265-4ca7-4e70-87cd-d53a7e701ca1" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-279d5265-4ca7-4e70-87cd-d53a7e701ca1" acquired by "delete_volume" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:36 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682" returned: 0 in 0.878s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:36 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 is being set with open permissions: ugo+rw Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b2664d-fa57-4304-b40c-cabbfb1b864c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:36 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 Jul 09 05:23:36 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Created reservations ['1093469b-77d9-4ea7-86fe-8008bd6f2b94', 'dfb87897-6c31-45e0-9b12-120528cb549d', '6d4e269a-0715-4d44-b4f9-b4f2ebcb49bb', 'e911b6da-8109-423a-9099-b8483b2e85c9'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:36 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1 Jul 09 05:23:36 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:36 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:36 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:36 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.077s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:36 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Deleted volume successfully. Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2e912f10-0a54-4bd5-9fad-c73b8ad1632d tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-fd23b779-1d24-46a3-937f-3acc9b55a4c8-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:36 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38" returned: 0 in 1.067s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:36 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38 Jul 09 05:23:36 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:37 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:37 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.958s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682" returned: 0 in 1.118s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:37 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Deleted volume successfully. Jul 09 05:23:37 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1" returned: 0 in 1.139s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad7b091f-c4a5-49d8-b102-ab9a9906ee24 tempest-CreateVolumesFromSnapshotTest-1910490836 None] Lock "cinder-f59818b3-c831-4353-b316-b5b09e8d478c-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:37 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1 Jul 09 05:23:37 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:37 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.info Jul 09 05:23:37 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:37 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4.0f59fc90-65c9-42f3-8a6c-bc237bdffd38" returned: 0 in 0.975s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Lock "cinder-quobyte-0f59fc90-65c9-42f3-8a6c-bc237bdffd38" released by "_delete_snapshot" :: held 3.926s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Lock "cinder-quobyte-a26498a2-1de6-487c-8bdf-69afab1c7ef4" released by "delete_snapshot" :: held 3.960s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:37 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Created reservations ['c904dcaf-d630-4f12-a54a-79c61037b053', '2ca5d29d-253d-4254-9df7-404cd0350fad', 'bb1c9fbe-7781-4fb6-90d1-8b1827df990e', 'a3406a3a-1e4d-470e-80da-60c7c3f42664'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:38 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.info" returned: 0 in 0.747s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:38 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.info is being set with open permissions: ugo+rw Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:38 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Delete snapshot completed successfully. Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4d4d8d4b-9de0-4bbe-9ba6-7a064e512f16 tempest-CinderUnicodeTest-783802347 None] Lock "cinder-0f59fc90-65c9-42f3-8a6c-bc237bdffd38-delete_snapshot" released by "delete_snapshot" :: held 4.217s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:38 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.info Jul 09 05:23:38 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:38 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-279d5265-4ca7-4e70-87cd-d53a7e701ca1" returned: 0 in 0.871s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-279d5265-4ca7-4e70-87cd-d53a7e701ca1" released by "delete_volume" :: held 2.082s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Acquiring lock "cinder-a26498a2-1de6-487c-8bdf-69afab1c7ef4-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Lock "cinder-a26498a2-1de6-487c-8bdf-69afab1c7ef4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Acquiring lock "cinder-quobyte-a26498a2-1de6-487c-8bdf-69afab1c7ef4" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created reservations ['b63c5b25-9e64-43dc-8bf8-928f03b3f3f5', 'f2ea95c2-413c-4573-80cb-ae344b88d27a', '4ed11c8a-f579-4394-840a-7552c2f26d06', '2e5c3a3a-328e-4b5d-860d-20a14ac3952b'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Lock "cinder-quobyte-a26498a2-1de6-487c-8bdf-69afab1c7ef4" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[697a8966-8a72-42e6-98c0-0bed23461a7f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:38 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:38 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:38 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 Jul 09 05:23:38 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:38 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.info" returned: 0 in 0.892s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.915s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:38 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-badc8e85-5e72-430f-ab00-18345dd256ee tempest-ProjectMemberTests-1563098389 None] Create snapshot completed successfully Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:39 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:39 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:39 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.702s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:39 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Deleted volume successfully. Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0f5a7fd9-dfdf-4f42-9e89-392dac3ead57 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-279d5265-4ca7-4e70-87cd-d53a7e701ca1-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-b2057332-ef57-4626-a310-3b343075d239-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:39 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4" returned: 0 in 0.972s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-b2057332-ef57-4626-a310-3b343075d239-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:39 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4 Jul 09 05:23:39 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "cinder-quobyte-b2057332-ef57-4626-a310-3b343075d239" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-b2057332-ef57-4626-a310-3b343075d239" acquired by "delete_volume" :: waited 0.029s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5500a74e-15d6-4052-8982-892a21f1b352]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-7211647c-353f-4091-9959-070d0c35c682-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-7211647c-353f-4091-9959-070d0c35c682-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-f92b8d8b-75c6-4c38-a3b3-fc0414338613" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-f92b8d8b-75c6-4c38-a3b3-fc0414338613" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-7211647c-353f-4091-9959-070d0c35c682" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-7211647c-353f-4091-9959-070d0c35c682" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Deleting offline snapshot 7211647c-353f-4091-9959-070d0c35c682 of volume f92b8d8b-75c6-4c38-a3b3-fc0414338613 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] snapshot_file for this snap is: volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a03c84d-557f-4508-aa53-703eb4029723]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:39 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239 Jul 09 05:23:39 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:39 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.791s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:39 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 Jul 09 05:23:39 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:23:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:23:40 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-a26498a2-1de6-487c-8bdf-69afab1c7ef4" returned: 0 in 0.944s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Lock "cinder-quobyte-a26498a2-1de6-487c-8bdf-69afab1c7ef4" released by "delete_volume" :: held 1.988s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Created reservations ['20ae8857-8e09-4312-be09-fe9fffb8c34c', '57648812-9555-462e-8323-cfdacb166d40', 'b33f2e7e-f4a0-44ba-a65e-94a9ae5aea09', 'cfcdb6c4-0a54-48a3-9352-4ec7f2eb4d95'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:40 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:40 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:40 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "cinder-970d4af5-a070-45c3-9837-12183d224f59-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239" returned: 0 in 1.062s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Lock "cinder-970d4af5-a070-45c3-9837-12183d224f59-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:40 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239 Jul 09 05:23:40 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:40 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682" returned: 0 in 0.935s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7c03af-45d3-40be-bc84-b52bdd40ae48]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "cinder-quobyte-970d4af5-a070-45c3-9837-12183d224f59" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Lock "cinder-quobyte-970d4af5-a070-45c3-9837-12183d224f59" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aea7eb-08de-49bb-baa7-2a837d6c1d37]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:40 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 Jul 09 05:23:40 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:40 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59 Jul 09 05:23:40 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:41 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.939s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:41 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-b2057332-ef57-4626-a310-3b343075d239" returned: 0 in 0.843s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:41 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Deleted volume successfully. Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-quobyte-b2057332-ef57-4626-a310-3b343075d239" released by "delete_volume" :: held 1.972s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c2c9fd51-99f6-486a-850b-714e53e7c2af tempest-CinderUnicodeTest-783802347 None] Lock "cinder-a26498a2-1de6-487c-8bdf-69afab1c7ef4-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Created reservations ['4daf4498-5393-4260-bff3-1f16a332ec10', 'a53b5fe0-0d50-4e63-bc87-499f08d74cee', '5c898eea-e4ef-4def-8876-f4179d3966b2', '74556353-3542-4af6-8ef9-40e28a126ffd'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Flow 'volume_create_manager' (560b44cb-b5c6-4f56-9328-3a3f49e94557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fbb0dd-a9cf-409d-9a58-439808ee1b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fbb0dd-a9cf-409d-9a58-439808ee1b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867140825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecea606e-4462-41e0-95ac-252cf6a8baae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb037b13cb1e4ee3afc5959e5963e9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:42Z,use_quota=True,user_id='5dc6396280eb4bbeaee76f0cc689374c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:41 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:41 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3d12d5-07cf-40ab-ae6b-53e4bce2e89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3d12d5-07cf-40ab-ae6b-53e4bce2e89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a339a21-c74c-40dd-b510-6f8706143878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a339a21-c74c-40dd-b510-6f8706143878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecea606e-4462-41e0-95ac-252cf6a8baae', 'volume_name': 'volume-ecea606e-4462-41e0-95ac-252cf6a8baae', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7638e626-cf3e-4370-ae8a-e42c568acc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7638e626-cf3e-4370-ae8a-e42c568acc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:41 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9327f8c0-df85-436b-b19a-c0530f493241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:41 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Volume ecea606e-4462-41e0-95ac-252cf6a8baae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecea606e-4462-41e0-95ac-252cf6a8baae', 'volume_size': 1} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867140825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecea606e-4462-41e0-95ac-252cf6a8baae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb037b13cb1e4ee3afc5959e5963e9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:42Z,use_quota=True,user_id='5dc6396280eb4bbeaee76f0cc689374c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Creating volume ecea606e-4462-41e0-95ac-252cf6a8baae {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:41 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613" returned: 0 in 1.100s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:41 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae 1073741824 Jul 09 05:23:41 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:41 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 Jul 09 05:23:41 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:41 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59" returned: 0 in 1.153s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:42 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59 Jul 09 05:23:42 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:42 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.812s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:42 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:42 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Deleted volume successfully. Jul 09 05:23:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-28a66bb8-2f55-4ec0-8657-a85922391218 tempest-CreateVolumesFromSourceVolumeTest-97757803 None] Lock "cinder-b2057332-ef57-4626-a310-3b343075d239-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:42 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682" returned: 0 in 0.939s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:42 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682 Jul 09 05:23:42 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:42 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-970d4af5-a070-45c3-9837-12183d224f59" returned: 0 in 0.967s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Lock "cinder-quobyte-970d4af5-a070-45c3-9837-12183d224f59" released by "delete_volume" :: held 2.181s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae 1073741824" returned: 0 in 1.187s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:42 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Created reservations ['2e74a04c-65f7-40ac-92db-cc80603ab8eb', 'fd292489-a628-45b4-baa8-63d5a3639dc8', '815f4872-0c66-4a64-8f79-fe052f6f83b7', '69a00840-04a9-4272-9934-1e2a14203cd5'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:43 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae Jul 09 05:23:43 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:43 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:43 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:43 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613.7211647c-353f-4091-9959-070d0c35c682" returned: 0 in 0.950s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-7211647c-353f-4091-9959-070d0c35c682" released by "_delete_snapshot" :: held 4.108s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-f92b8d8b-75c6-4c38-a3b3-fc0414338613" released by "delete_snapshot" :: held 4.142s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:43 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Created reservations ['83426309-1fc7-4bce-b8eb-b78572b15d1c', '7b8f43ec-66e7-4254-9f7a-acb9d2a87ada', '40721024-464e-47da-9002-c1ded4f6429f', '29729a7d-1a73-46fd-a397-268400237d3c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:43 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Delete snapshot completed successfully. Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-70fc3605-adc5-411f-9735-727857ed8b1d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-7211647c-353f-4091-9959-070d0c35c682-delete_snapshot" released by "delete_snapshot" :: held 4.387s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:44 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.842s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:44 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:44 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Deleted volume successfully. Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae" returned: 0 in 1.005s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] <== create_volume: return (2269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9327f8c0-df85-436b-b19a-c0530f493241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecea606e-4462-41e0-95ac-252cf6a8baae', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39492f75-f0cc-4dd6-8135-2ae59b027702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-610c37c8-598c-4bf4-8c70-b6ae185706d0 tempest-CinderUnicodeTest-783802347 None] Lock "cinder-970d4af5-a070-45c3-9837-12183d224f59-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:44 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Volume volume-ecea606e-4462-41e0-95ac-252cf6a8baae (ecea606e-4462-41e0-95ac-252cf6a8baae): created successfully Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39492f75-f0cc-4dd6-8135-2ae59b027702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Flow 'volume_create_manager' (560b44cb-b5c6-4f56-9328-3a3f49e94557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:44 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-96f361de-b203-40cf-ad33-4de5df370d71 tempest-ProjectReaderTests-445434748 None] Created volume successfully. Jul 09 05:23:44 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-f92b8d8b-75c6-4c38-a3b3-fc0414338613-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-f92b8d8b-75c6-4c38-a3b3-fc0414338613-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-f92b8d8b-75c6-4c38-a3b3-fc0414338613" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:45 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Creating offline snapshot b3238966-731a-4629-96b1-d725a37420ea of volume ecea606e-4462-41e0-95ac-252cf6a8baae {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:23:45 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-f92b8d8b-75c6-4c38-a3b3-fc0414338613" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6662f1cb-6c01-40ca-843d-57307580f012]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:45 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd88d065-3e79-4c1c-90be-f9db662f87dc]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:45 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae Jul 09 05:23:45 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:45 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 Jul 09 05:23:45 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:46 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:46 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae" returned: 0 in 0.967s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613" returned: 0 in 0.960s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:46 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea 1G Jul 09 05:23:46 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:46 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613 Jul 09 05:23:46 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-333f9d51-e0cc-40f9-ae28-3d708ab9b681 tempest-ProjectAdminTests-1634744402 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87161) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 05:23:46 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f92b8d8b-75c6-4c38-a3b3-fc0414338613" returned: 0 in 0.712s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-f92b8d8b-75c6-4c38-a3b3-fc0414338613" released by "delete_volume" :: held 1.738s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Created reservations ['29aa2a3a-16f6-4180-9ccb-2da97d870562', '16112f90-9571-4257-978d-1c51a2cd48cc', '116cbde3-1d64-4d5c-a7da-c7ec307605ac', 'a25576a2-cb86-41c6-a037-965ce49472d8'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:46 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea 1G" returned: 0 in 0.850s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecea606e-4462-41e0-95ac-252cf6a8baae -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:46 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecea606e-4462-41e0-95ac-252cf6a8baae -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:46 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:47 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:47 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:47 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecea606e-4462-41e0-95ac-252cf6a8baae -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea" returned: 0 in 0.831s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:47 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea is being set with open permissions: ugo+rw Jul 09 05:23:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:47 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea Jul 09 05:23:47 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:47 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.993s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:47 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:48 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Deleted volume successfully. Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ecadc677-f9af-4b8d-b81b-25c6e2207dd2 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-f92b8d8b-75c6-4c38-a3b3-fc0414338613-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (76990ed5-6f8f-48fc-9981-03f6197b6188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a3e08a-5d0e-460c-a306-b75ace61794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a3e08a-5d0e-460c-a306-b75ace61794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848078141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133f1df6-da74-4848-abe2-34dd2e3d2ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:48Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1310659-8de2-43b7-9b49-466acc78fa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1310659-8de2-43b7-9b49-466acc78fa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27df327-3195-4027-b3a0-1703bbf3d435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27df327-3195-4027-b3a0-1703bbf3d435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133f1df6-da74-4848-abe2-34dd2e3d2ff3', 'volume_name': 'volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcde4389-642b-457f-9c74-890baea90107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcde4389-642b-457f-9c74-890baea90107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fdd593-0a73-4afb-855b-5cee902652df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:48 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Volume 133f1df6-da74-4848-abe2-34dd2e3d2ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3', 'volume_size': 1} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:48 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea" returned: 0 in 0.826s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:48 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.info Jul 09 05:23:48 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:49 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.info" returned: 0 in 0.743s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:49 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.info is being set with open permissions: ugo+rw Jul 09 05:23:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:49 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.info Jul 09 05:23:49 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:50 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.info" returned: 0 in 0.763s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.104s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.887s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848078141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133f1df6-da74-4848-abe2-34dd2e3d2ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:48Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Creating volume 133f1df6-da74-4848-abe2-34dd2e3d2ff3 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:50 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:50 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 1073741824 Jul 09 05:23:50 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:50 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-bbc388b2-078a-49c2-8b90-bb1d26a185fd tempest-ProjectReaderTests-445434748 None] Create snapshot completed successfully Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-b3238966-731a-4629-96b1-d725a37420ea-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Lock "cinder-b3238966-731a-4629-96b1-d725a37420ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-ecea606e-4462-41e0-95ac-252cf6a8baae" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-ecea606e-4462-41e0-95ac-252cf6a8baae" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-b3238966-731a-4629-96b1-d725a37420ea" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-b3238966-731a-4629-96b1-d725a37420ea" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Deleting offline snapshot b3238966-731a-4629-96b1-d725a37420ea of volume ecea606e-4462-41e0-95ac-252cf6a8baae {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] snapshot_file for this snap is: volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[350e1b98-103c-419e-b95f-a4c7790c0ed8]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:50 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea Jul 09 05:23:50 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:51 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 1073741824" returned: 0 in 1.123s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:51 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 Jul 09 05:23:51 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:51 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea" returned: 0 in 0.931s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecea606e-4462-41e0-95ac-252cf6a8baae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:23:51 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd7efee-595b-4221-8c2b-95ba04482035]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:51 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae Jul 09 05:23:51 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:52 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3" returned: 0 in 0.937s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:23:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fdd593-0a73-4afb-855b-5cee902652df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab2b801-aff9-4a0f-af78-e81947e766a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:52 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Volume volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 (133f1df6-da74-4848-abe2-34dd2e3d2ff3): created successfully Jul 09 05:23:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab2b801-aff9-4a0f-af78-e81947e766a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:52 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (76990ed5-6f8f-48fc-9981-03f6197b6188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:52 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f7dfdf1d-9d98-473b-ade3-852ed3b14249 tempest-ProjectMemberTests-1563098389 None] Created volume successfully. Jul 09 05:23:52 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae" returned: 0 in 0.944s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:52 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea Jul 09 05:23:52 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:53 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea" returned: 0 in 0.829s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:53 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea Jul 09 05:23:53 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Creating offline snapshot ce96cca3-30d2-47fa-944b-b21e4e461132 of volume 133f1df6-da74-4848-abe2-34dd2e3d2ff3 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:23:53 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a180ecf-ce87-4e41-b6ee-2690c8bcc9ac]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:53 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 Jul 09 05:23:53 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:54 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae.b3238966-731a-4629-96b1-d725a37420ea" returned: 0 in 0.736s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-b3238966-731a-4629-96b1-d725a37420ea" released by "_delete_snapshot" :: held 3.600s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-ecea606e-4462-41e0-95ac-252cf6a8baae" released by "delete_snapshot" :: held 3.634s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:54 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Created reservations ['b7561b8e-832b-4ef1-9b19-2f281fb3263f', 'c85a209d-87e8-47f7-bca7-2dbe852f2ed7', '159e8daf-345d-40b3-b3b9-c9b3cd64bdee', 'e04f6f0c-fccc-448f-8211-8dfaf143c3ff'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Delete snapshot completed successfully. Jul 09 05:23:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2a97991f-46e0-4026-9962-6646b7fd016f tempest-ProjectReaderTests-445434748 None] Lock "cinder-b3238966-731a-4629-96b1-d725a37420ea-delete_snapshot" released by "delete_snapshot" :: held 3.847s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:54 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3" returned: 0 in 0.890s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:54 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 1G Jul 09 05:23:54 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-ecea606e-4462-41e0-95ac-252cf6a8baae-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Lock "cinder-ecea606e-4462-41e0-95ac-252cf6a8baae-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-ecea606e-4462-41e0-95ac-252cf6a8baae" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:23:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-ecea606e-4462-41e0-95ac-252cf6a8baae" acquired by "delete_volume" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:23:55 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b68a24-aef0-47fc-86ba-4d9a1311a1a8]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:23:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:55 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae Jul 09 05:23:55 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:55 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 1G" returned: 0 in 0.888s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:55 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 Jul 09 05:23:55 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:55 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae" returned: 0 in 0.828s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:56 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae Jul 09 05:23:56 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:56 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132" returned: 0 in 0.963s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:56 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 is being set with open permissions: ugo+rw Jul 09 05:23:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:56 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 Jul 09 05:23:56 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:57 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ecea606e-4462-41e0-95ac-252cf6a8baae" returned: 0 in 1.139s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-ecea606e-4462-41e0-95ac-252cf6a8baae" released by "delete_volume" :: held 2.047s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Created reservations ['47a9b81c-1125-48c5-a49c-2be5bd11ab36', '5c37e402-9489-444c-8437-9a327729aeec', '80b2c179-f260-4ba8-a9d7-00944b07b9a6', '752abc51-cc3b-4b44-9a4a-ab87f03b2d01'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:57 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:23:57 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:57 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132" returned: 0 in 1.038s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:57 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.info Jul 09 05:23:57 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:58 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.939s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:58 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:23:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Deleted volume successfully. Jul 09 05:23:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f0e4a4c2-5ee9-4a96-8dd7-f3363d245737 tempest-ProjectReaderTests-445434748 None] Lock "cinder-ecea606e-4462-41e0-95ac-252cf6a8baae-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:23:58 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.info" returned: 0 in 0.963s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:58 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.info is being set with open permissions: ugo+rw Jul 09 05:23:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:58 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.info Jul 09 05:23:58 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Flow 'volume_create_manager' (997254ae-ede9-46dd-9159-70b69922816a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72808919-e446-4cb2-8c18-c3aee92a0cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72808919-e446-4cb2-8c18-c3aee92a0cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173689367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6016ce4e-f4e8-451a-b6bf-bc12d7811ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb037b13cb1e4ee3afc5959e5963e9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:59Z,use_quota=True,user_id='5dc6396280eb4bbeaee76f0cc689374c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af458665-b416-4780-b0af-71a9a9fdb190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af458665-b416-4780-b0af-71a9a9fdb190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958dae0c-04ea-4573-92cd-21b0d41b13f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958dae0c-04ea-4573-92cd-21b0d41b13f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6016ce4e-f4e8-451a-b6bf-bc12d7811ff0', 'volume_name': 'volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354045ae-9074-4c22-891c-b4d536b68197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354045ae-9074-4c22-891c-b4d536b68197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d433760d-8ed4-4239-b087-9c86ffa8f5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:23:59 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Volume 6016ce4e-f4e8-451a-b6bf-bc12d7811ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0', 'volume_size': 1} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:59 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.info" returned: 0 in 0.971s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.830s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173689367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6016ce4e-f4e8-451a-b6bf-bc12d7811ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb037b13cb1e4ee3afc5959e5963e9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:23:59Z,use_quota=True,user_id='5dc6396280eb4bbeaee76f0cc689374c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Creating volume 6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:23:59 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:23:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:23:59 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 1073741824 Jul 09 05:23:59 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:23:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d982d5b7-19ed-4895-84ac-409981fcacec tempest-ProjectMemberTests-1563098389 None] Create snapshot completed successfully Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-ce96cca3-30d2-47fa-944b-b21e4e461132-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Lock "cinder-ce96cca3-30d2-47fa-944b-b21e4e461132-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-133f1df6-da74-4848-abe2-34dd2e3d2ff3" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-133f1df6-da74-4848-abe2-34dd2e3d2ff3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-ce96cca3-30d2-47fa-944b-b21e4e461132" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-ce96cca3-30d2-47fa-944b-b21e4e461132" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Deleting offline snapshot ce96cca3-30d2-47fa-944b-b21e4e461132 of volume 133f1df6-da74-4848-abe2-34dd2e3d2ff3 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] snapshot_file for this snap is: volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6283eef-da8c-42f5-b508-97f95a4b40d2]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:00 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 Jul 09 05:24:00 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:00 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 1073741824" returned: 0 in 1.111s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:00 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 Jul 09 05:24:00 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:01 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132" returned: 0 in 1.057s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[750017b0-cc8d-411e-a845-57b5e6c7220a]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:01 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 Jul 09 05:24:01 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:01 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" returned: 0 in 0.947s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d433760d-8ed4-4239-b087-9c86ffa8f5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7870f7ea-ce63-4aa8-bee1-3a43756ecb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:01 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Volume volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 (6016ce4e-f4e8-451a-b6bf-bc12d7811ff0): created successfully Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7870f7ea-ce63-4aa8-bee1-3a43756ecb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Flow 'volume_create_manager' (997254ae-ede9-46dd-9159-70b69922816a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:01 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e2253887-f34a-409c-8957-53c1340f16b7 tempest-ProjectReaderTests-445434748 None] Created volume successfully. Jul 09 05:24:02 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3" returned: 0 in 0.840s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:02 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 Jul 09 05:24:02 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Creating offline snapshot 52765b3d-ea47-44cc-b3a9-de342c559f20 of volume 6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:24:02 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c6fcb4-33a5-448b-8253-9c405b6e52d9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:02 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 Jul 09 05:24:02 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:03 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132" returned: 0 in 0.969s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:03 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132 Jul 09 05:24:03 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:03 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" returned: 0 in 1.012s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:03 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 1G Jul 09 05:24:03 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:03 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:24:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Flow 'volume_create_manager' (8632b3f6-4b61-4157-b3a3-43bbe13a4bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:03 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203abf30-19bf-48dd-91a9-3ad9a4302001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203abf30-19bf-48dd-91a9-3ad9a4302001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130875855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760db139-1cab-43fc-baf1-cd32f0617455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4c6378fd3343de9cb23b9c11e60162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:04Z,use_quota=True,user_id='fbbcb8dcb0fa4a8d9eb618e958b9e6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc83817-22d5-452e-abe4-6779b863bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc83817-22d5-452e-abe4-6779b863bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf9a8a3-d9a9-460b-b7db-4ea6d5a381ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf9a8a3-d9a9-460b-b7db-4ea6d5a381ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760db139-1cab-43fc-baf1-cd32f0617455', 'volume_name': 'volume-760db139-1cab-43fc-baf1-cd32f0617455', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71545660-fe90-4f15-b53d-0c885c1a829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71545660-fe90-4f15-b53d-0c885c1a829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43761c20-a028-4658-9019-0b5875eee1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:04 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Volume 760db139-1cab-43fc-baf1-cd32f0617455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760db139-1cab-43fc-baf1-cd32f0617455', 'volume_size': 1} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:04 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3.ce96cca3-30d2-47fa-944b-b21e4e461132" returned: 0 in 0.927s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-ce96cca3-30d2-47fa-944b-b21e4e461132" released by "_delete_snapshot" :: held 3.990s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-133f1df6-da74-4848-abe2-34dd2e3d2ff3" released by "delete_snapshot" :: held 4.034s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Created reservations ['26b16000-f453-413d-8535-234f4ba3d491', 'd3cb17a8-010b-4135-9b67-5a9ec0b7584a', 'b901ef83-02d5-4a43-8ac7-5d163d799a58', '846b0b63-e5fe-45a7-97b4-cb899f7422db'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Delete snapshot completed successfully. Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4ccc93b8-4872-4447-8f3c-9527ff7d72bc tempest-ProjectMemberTests-1563098389 None] Lock "cinder-ce96cca3-30d2-47fa-944b-b21e4e461132-delete_snapshot" released by "delete_snapshot" :: held 4.192s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-133f1df6-da74-4848-abe2-34dd2e3d2ff3-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-133f1df6-da74-4848-abe2-34dd2e3d2ff3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-133f1df6-da74-4848-abe2-34dd2e3d2ff3" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-133f1df6-da74-4848-abe2-34dd2e3d2ff3" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f315a2-f47f-4a55-b870-bcac763c8860]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:04 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 Jul 09 05:24:04 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:04 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 1G" returned: 0 in 0.988s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:04 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 Jul 09 05:24:04 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:05 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3" returned: 0 in 0.821s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:05 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3 Jul 09 05:24:05 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:05 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20" returned: 0 in 0.738s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:05 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 is being set with open permissions: ugo+rw Jul 09 05:24:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:05 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 Jul 09 05:24:05 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:06 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-133f1df6-da74-4848-abe2-34dd2e3d2ff3" returned: 0 in 0.773s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-133f1df6-da74-4848-abe2-34dd2e3d2ff3" released by "delete_volume" :: held 1.675s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:06 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20" returned: 0 in 0.702s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Created reservations ['747ea28f-6f6f-4c84-99d5-565556676d33', 'c8301fc0-a3f8-4b73-89bc-5b8b979d6ec0', 'e3e62703-76e6-4705-ba54-92ee454bcb2a', '339a0a54-ac91-4d69-9f69-38e7da7557b7'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:06 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.info Jul 09 05:24:06 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:06 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:24:06 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:07 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.info" returned: 0 in 0.760s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:07 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.info is being set with open permissions: ugo+rw Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:07 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.info Jul 09 05:24:07 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:24:07 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (abaea733-055b-40e1-90a1-73e0ee2778f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94761cc-fa73-48d9-9739-ba3332d950fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.034s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:24:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Deleted volume successfully. Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94761cc-fa73-48d9-9739-ba3332d950fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745874569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b05ad9-ee0d-4572-a010-3c71bcddb5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:07Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61716ee1-cf20-4e4b-9b11-8483deba1302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61716ee1-cf20-4e4b-9b11-8483deba1302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf80754-13d4-425e-97b4-a5df5782ce9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf80754-13d4-425e-97b4-a5df5782ce9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b05ad9-ee0d-4572-a010-3c71bcddb5bd', 'volume_name': 'volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9fac96-79d5-46c2-8d32-c8f3174d60d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9fac96-79d5-46c2-8d32-c8f3174d60d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7495b379-df42-442d-b8f8-65fded8927a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:07 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Volume 95b05ad9-ee0d-4572-a010-3c71bcddb5bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd', 'volume_size': 1} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-cf7465b3-32ed-4c74-8ef9-8e68555b565d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-133f1df6-da74-4848-abe2-34dd2e3d2ff3-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:07 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.info" returned: 0 in 0.738s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.059s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.766s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130875855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760db139-1cab-43fc-baf1-cd32f0617455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4c6378fd3343de9cb23b9c11e60162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:04Z,use_quota=True,user_id='fbbcb8dcb0fa4a8d9eb618e958b9e6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Creating volume 760db139-1cab-43fc-baf1-cd32f0617455 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:24:07 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:24:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:07 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455 1073741824 Jul 09 05:24:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e016802d-9d00-4788-8d24-fde4f1925ef4 tempest-ProjectReaderTests-445434748 None] Create snapshot completed successfully Jul 09 05:24:07 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-52765b3d-ea47-44cc-b3a9-de342c559f20-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Lock "cinder-52765b3d-ea47-44cc-b3a9-de342c559f20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-52765b3d-ea47-44cc-b3a9-de342c559f20" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-52765b3d-ea47-44cc-b3a9-de342c559f20" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Deleting offline snapshot 52765b3d-ea47-44cc-b3a9-de342c559f20 of volume 6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] snapshot_file for this snap is: volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[22031e35-0336-45fd-9b86-0320a0988fad]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:08 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 Jul 09 05:24:08 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:08 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455 1073741824" returned: 0 in 1.031s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:08 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455 Jul 09 05:24:08 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:09 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20" returned: 0 in 0.853s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47f43c0-30b8-4460-a53e-26a4ffe8ed87]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:09 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 Jul 09 05:24:09 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:09 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455" returned: 0 in 0.699s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.092s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745874569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b05ad9-ee0d-4572-a010-3c71bcddb5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:07Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Creating volume 95b05ad9-ee0d-4572-a010-3c71bcddb5bd {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:24:09 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:09 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd 1073741824 Jul 09 05:24:09 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43761c20-a028-4658-9019-0b5875eee1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760db139-1cab-43fc-baf1-cd32f0617455', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a51a8e-52e4-4c6a-88c0-1c190ad92cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:09 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Volume volume-760db139-1cab-43fc-baf1-cd32f0617455 (760db139-1cab-43fc-baf1-cd32f0617455): created successfully Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a51a8e-52e4-4c6a-88c0-1c190ad92cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:09 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Flow 'volume_create_manager' (8632b3f6-4b61-4157-b3a3-43bbe13a4bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-19459365-def3-4379-9f49-d24849c416a7 tempest-ProjectReaderTests-1739331507 None] Created volume successfully. Jul 09 05:24:10 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" returned: 0 in 0.841s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:10 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 Jul 09 05:24:10 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Acquiring lock "cinder-760db139-1cab-43fc-baf1-cd32f0617455-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Lock "cinder-760db139-1cab-43fc-baf1-cd32f0617455-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Acquiring lock "cinder-quobyte-760db139-1cab-43fc-baf1-cd32f0617455" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Lock "cinder-quobyte-760db139-1cab-43fc-baf1-cd32f0617455" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7f18cd-1992-4af9-9be3-e7d5ea622863]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:10 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd 1073741824" returned: 0 in 1.056s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:10 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455 Jul 09 05:24:10 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:10 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd Jul 09 05:24:10 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:10 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20" returned: 0 in 0.850s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:10 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20 Jul 09 05:24:10 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:11 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" returned: 0 in 0.730s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7495b379-df42-442d-b8f8-65fded8927a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2207e0f-9952-4149-8ac8-d09eafc18421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Volume volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd (95b05ad9-ee0d-4572-a010-3c71bcddb5bd): created successfully Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2207e0f-9952-4149-8ac8-d09eafc18421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (abaea733-055b-40e1-90a1-73e0ee2778f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-cc503b80-40a1-4fa7-b275-9d76f52f94c6 tempest-ProjectMemberTests-1563098389 None] Created volume successfully. Jul 09 05:24:11 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455" returned: 0 in 1.067s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:11 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0.52765b3d-ea47-44cc-b3a9-de342c559f20" returned: 0 in 0.787s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:11 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455 Jul 09 05:24:11 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-52765b3d-ea47-44cc-b3a9-de342c559f20" released by "_delete_snapshot" :: held 3.550s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" released by "delete_snapshot" :: held 3.584s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Created reservations ['0b21d4c0-bb7f-40dc-aebd-9dbbb0c6d377', '710d53a8-5035-43c4-86ef-d8cfc6b7fecd', '6be1d25e-cb53-4302-b5a2-3e55f58c1cf6', '9d3d473e-3e8a-4532-9919-161a775649f2'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Creating offline snapshot 8cfd9b78-c6d7-498f-94ea-da661644f8d2 of volume 95b05ad9-ee0d-4572-a010-3c71bcddb5bd {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:24:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Delete snapshot completed successfully. Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[29af7d9a-23d6-4dfe-b011-96d2a0c6fdbf]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ad64f575-7e46-4eec-9d07-8b8ace86e5c1 tempest-ProjectReaderTests-445434748 None] Lock "cinder-52765b3d-ea47-44cc-b3a9-de342c559f20-delete_snapshot" released by "delete_snapshot" :: held 3.825s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:12 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd Jul 09 05:24:12 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Lock "cinder-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" acquired by "delete_volume" :: waited 0.033s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:12 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-760db139-1cab-43fc-baf1-cd32f0617455" returned: 0 in 0.885s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f796059-23c1-4e32-bbe9-9df4604c10f2]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Lock "cinder-quobyte-760db139-1cab-43fc-baf1-cd32f0617455" released by "delete_volume" :: held 2.019s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Created reservations ['b6e4d8b5-bb60-48a4-9f09-4b1c70c780fe', '1d28767d-351f-4a95-8ba4-b1c62b3bca83', 'fae8a6f0-e18a-4d27-a7b9-ed6e62612806', '87023a15-ca37-468c-8cd0-d9d86e18514d'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:12 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 Jul 09 05:24:12 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:12 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:24:12 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:12 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" returned: 0 in 1.024s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:13 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 1G Jul 09 05:24:13 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:13 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.735s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:13 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:24:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Deleted volume successfully. Jul 09 05:24:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-c1f756b2-67f0-4dd2-b549-447bec3c7062 tempest-ProjectReaderTests-1739331507 None] Lock "cinder-760db139-1cab-43fc-baf1-cd32f0617455-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:13 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" returned: 0 in 1.061s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:13 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0 Jul 09 05:24:13 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:14 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 1G" returned: 0 in 1.084s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:14 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 Jul 09 05:24:14 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Flow 'volume_create_manager' (c11620ca-d0f6-4b70-ba06-b4bfd9ec42aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1a5103-15db-40bd-91de-b05507904b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1a5103-15db-40bd-91de-b05507904b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1765228179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0959dc-6d8b-4641-a075-d99b805398ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099cd7a432ab4e95aa0c0af5196b1b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:14Z,use_quota=True,user_id='e35a8122799f450a83619b3b05bac17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdbc2c2-c124-4c20-a641-b8d3d794dd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdbc2c2-c124-4c20-a641-b8d3d794dd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35db7b84-1791-454a-bf37-e1d1c2962ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35db7b84-1791-454a-bf37-e1d1c2962ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f0959dc-6d8b-4641-a075-d99b805398ad', 'volume_name': 'volume-9f0959dc-6d8b-4641-a075-d99b805398ad', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1277cac2-257e-4909-8a23-9a66b226bacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1277cac2-257e-4909-8a23-9a66b226bacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c477c23-2465-40b5-bf5a-424fe88a3c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:14 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Volume 9f0959dc-6d8b-4641-a075-d99b805398ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f0959dc-6d8b-4641-a075-d99b805398ad', 'volume_size': 1} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Flow 'volume_create_manager' (ec5e549f-3ed3-4d1f-ad5c-333b646b7da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa264e5-2807-4d37-92ec-1e9fef91542b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa264e5-2807-4d37-92ec-1e9fef91542b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710484928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a33c7c-6178-4247-b028-10b224bc33ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4c6378fd3343de9cb23b9c11e60162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:14Z,use_quota=True,user_id='fbbcb8dcb0fa4a8d9eb618e958b9e6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbac304-2153-4330-9734-004c19a0916c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbac304-2153-4330-9734-004c19a0916c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c6c72b-6fe2-43c1-9f9e-afd1012a643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c6c72b-6fe2-43c1-9f9e-afd1012a643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a33c7c-6178-4247-b028-10b224bc33ae', 'volume_name': 'volume-52a33c7c-6178-4247-b028-10b224bc33ae', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9750549d-1487-410b-a2a5-bb7f87926117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:14 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9750549d-1487-410b-a2a5-bb7f87926117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c25331-74c0-4b5d-bfb9-5c305ed8942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:14 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Volume 52a33c7c-6178-4247-b028-10b224bc33ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a33c7c-6178-4247-b028-10b224bc33ae', 'volume_size': 1} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" returned: 0 in 0.855s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0" released by "delete_volume" :: held 1.989s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Created reservations ['55800d62-d74c-4583-90c8-94346dd619d9', '5d023d16-1708-4735-b8cb-fdfbc6ea7b36', '47b77117-6d01-42f3-bf73-03784d938803', 'd0c08984-b716-4681-a0f1-3ec912d85933'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:14 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:24:14 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:14 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2" returned: 0 in 0.884s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:14 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 is being set with open permissions: ugo+rw Jul 09 05:24:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:15 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 Jul 09 05:24:15 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Flow 'volume_create_manager' (d444526b-3746-4c0c-8185-eaab8c296aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd452e87-80a8-42a4-b695-d851b986105b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd452e87-80a8-42a4-b695-d851b986105b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82215515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3789aebf-faa3-461a-989a-74fd5cb834e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb037b13cb1e4ee3afc5959e5963e9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:15Z,use_quota=True,user_id='5dc6396280eb4bbeaee76f0cc689374c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2566dce-bbee-4e76-9a1d-85a79281c205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2566dce-bbee-4e76-9a1d-85a79281c205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2548d62b-558c-4ba6-b7ca-8e4cf03f3c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2548d62b-558c-4ba6-b7ca-8e4cf03f3c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3789aebf-faa3-461a-989a-74fd5cb834e0', 'volume_name': 'volume-3789aebf-faa3-461a-989a-74fd5cb834e0', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744e0163-b849-4b58-8504-36cbed44e02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744e0163-b849-4b58-8504-36cbed44e02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edea1bd7-171f-46a0-9ce7-2142fb61e177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:15 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Volume 3789aebf-faa3-461a-989a-74fd5cb834e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3789aebf-faa3-461a-989a-74fd5cb834e0', 'volume_size': 1} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:15 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.693s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:24:15 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Deleted volume successfully. Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-1eb7f754-8978-4ca9-bbc0-e3bd2f082308 tempest-ProjectReaderTests-445434748 None] Lock "cinder-6016ce4e-f4e8-451a-b6bf-bc12d7811ff0-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:15 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2" returned: 0 in 0.753s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:15 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.info Jul 09 05:24:15 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:16 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.info" returned: 0 in 0.628s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:16 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.info is being set with open permissions: ugo+rw Jul 09 05:24:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:16 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.info Jul 09 05:24:16 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:16 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.info" returned: 0 in 0.603s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.089s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.714s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1765228179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0959dc-6d8b-4641-a075-d99b805398ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099cd7a432ab4e95aa0c0af5196b1b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:14Z,use_quota=True,user_id='e35a8122799f450a83619b3b05bac17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Creating volume 9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:24:17 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:17 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad 1073741824 Jul 09 05:24:17 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:17 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-26679792-2979-4cda-87dd-0b6413ed8023 tempest-ProjectMemberTests-1563098389 None] Create snapshot completed successfully Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-8cfd9b78-c6d7-498f-94ea-da661644f8d2-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-8cfd9b78-c6d7-498f-94ea-da661644f8d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-8cfd9b78-c6d7-498f-94ea-da661644f8d2" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-8cfd9b78-c6d7-498f-94ea-da661644f8d2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Deleting offline snapshot 8cfd9b78-c6d7-498f-94ea-da661644f8d2 of volume 95b05ad9-ee0d-4572-a010-3c71bcddb5bd {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] snapshot_file for this snap is: volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7da072d-4088-460e-99f1-463988ebb0a9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:17 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 Jul 09 05:24:17 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:17 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad 1073741824" returned: 0 in 0.806s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:17 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad Jul 09 05:24:17 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:18 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2" returned: 0 in 0.775s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52c5182-0b68-41fd-be21-77214afa4a81]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:18 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd Jul 09 05:24:18 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:18 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad" returned: 0 in 0.688s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.094s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710484928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a33c7c-6178-4247-b028-10b224bc33ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4c6378fd3343de9cb23b9c11e60162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:14Z,use_quota=True,user_id='fbbcb8dcb0fa4a8d9eb618e958b9e6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Creating volume 52a33c7c-6178-4247-b028-10b224bc33ae {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:24:18 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c477c23-2465-40b5-bf5a-424fe88a3c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f0959dc-6d8b-4641-a075-d99b805398ad', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:18 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae 1073741824 Jul 09 05:24:18 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af245320-4653-4ac2-9154-7515f36e3308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:18 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Volume volume-9f0959dc-6d8b-4641-a075-d99b805398ad (9f0959dc-6d8b-4641-a075-d99b805398ad): created successfully Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af245320-4653-4ac2-9154-7515f36e3308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Flow 'volume_create_manager' (c11620ca-d0f6-4b70-ba06-b4bfd9ec42aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:18 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e7f7566d-40d9-4fc1-bcea-9859afe99b45 tempest-SnapshotDependencyTests-382873767 None] Created volume successfully. Jul 09 05:24:18 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" returned: 0 in 0.772s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:18 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 Jul 09 05:24:18 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:19 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae 1073741824" returned: 0 in 0.934s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:19 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae Jul 09 05:24:19 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:19 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2" returned: 0 in 0.794s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:19 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2 Jul 09 05:24:19 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:20 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae" returned: 0 in 0.644s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.918s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82215515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3789aebf-faa3-461a-989a-74fd5cb834e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb037b13cb1e4ee3afc5959e5963e9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:15Z,use_quota=True,user_id='5dc6396280eb4bbeaee76f0cc689374c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Creating volume 3789aebf-faa3-461a-989a-74fd5cb834e0 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:24:20 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c25331-74c0-4b5d-bfb9-5c305ed8942c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a33c7c-6178-4247-b028-10b224bc33ae', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d97efe-0734-4d9b-bc48-70a9c62a3712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:20 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 1073741824 Jul 09 05:24:20 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:20 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Volume volume-52a33c7c-6178-4247-b028-10b224bc33ae (52a33c7c-6178-4247-b028-10b224bc33ae): created successfully Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d97efe-0734-4d9b-bc48-70a9c62a3712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Flow 'volume_create_manager' (ec5e549f-3ed3-4d1f-ad5c-333b646b7da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:20 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7ded2800-9ae2-4fc1-807a-ee92dec8f967 tempest-ProjectReaderTests-1739331507 None] Created volume successfully. Jul 09 05:24:20 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd.8cfd9b78-c6d7-498f-94ea-da661644f8d2" returned: 0 in 0.633s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-8cfd9b78-c6d7-498f-94ea-da661644f8d2" released by "_delete_snapshot" :: held 3.075s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" released by "delete_snapshot" :: held 3.100s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Created reservations ['5d2e1336-5a42-43c2-96b2-198f980f1d5a', '3beb0075-53f9-4856-a987-2c6ff787a000', '5276fe6f-f5e3-4dc5-b9c1-eb70b314b4eb', '349a30ea-b6c1-4b01-9e5c-487d1c10f0ce'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:20 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Delete snapshot completed successfully. Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-13e5bf94-0ff0-425e-903a-ef141a48abe6 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-8cfd9b78-c6d7-498f-94ea-da661644f8d2-delete_snapshot" released by "delete_snapshot" :: held 3.244s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Acquiring lock "cinder-52a33c7c-6178-4247-b028-10b224bc33ae-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Lock "cinder-52a33c7c-6178-4247-b028-10b224bc33ae-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Acquiring lock "cinder-quobyte-52a33c7c-6178-4247-b028-10b224bc33ae" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Lock "cinder-quobyte-52a33c7c-6178-4247-b028-10b224bc33ae" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabe2bd7-01d7-4b8d-9fdc-47cf8b3e7d29]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:21 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae Jul 09 05:24:21 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:21 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 1073741824" returned: 0 in 0.866s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:21 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 Jul 09 05:24:21 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-95b05ad9-ee0d-4572-a010-3c71bcddb5bd-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-95b05ad9-ee0d-4572-a010-3c71bcddb5bd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6bc7a4-edc5-4754-9829-c3b14fe59d87]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:21 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd Jul 09 05:24:21 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:21 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0" returned: 0 in 0.643s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.074s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Creating offline snapshot cd7a12d0-1486-4b27-aa39-4aab934215fe of volume 9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:24:21 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edea1bd7-171f-46a0-9ce7-2142fb61e177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3789aebf-faa3-461a-989a-74fd5cb834e0', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199e5bbd-df34-4773-a896-ef73e96692e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae" returned: 0 in 0.888s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba519d5-2c93-4ef0-b176-b63a88b96b5f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:21 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae Jul 09 05:24:21 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:21 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Volume volume-3789aebf-faa3-461a-989a-74fd5cb834e0 (3789aebf-faa3-461a-989a-74fd5cb834e0): created successfully Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199e5bbd-df34-4773-a896-ef73e96692e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:21 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Flow 'volume_create_manager' (d444526b-3746-4c0c-8185-eaab8c296aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:21 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a36341a4-bb13-41d3-83c7-fd7b68f26671 tempest-ProjectReaderTests-445434748 None] Created volume successfully. Jul 09 05:24:21 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad Jul 09 05:24:21 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:22 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" returned: 0 in 0.792s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:22 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd Jul 09 05:24:22 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:22 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-52a33c7c-6178-4247-b028-10b224bc33ae" returned: 0 in 0.684s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Lock "cinder-quobyte-52a33c7c-6178-4247-b028-10b224bc33ae" released by "delete_volume" :: held 1.618s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Created reservations ['92fa0d21-8e4c-4222-81ef-09c3c5c39760', '11f4b424-54c5-43b7-956b-fe47ed770f50', 'e9ccd220-c264-4f0d-a2b4-afcd880099a9', '3b0a5721-de9e-4761-861e-35cd6497a36e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:22 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad" returned: 0 in 0.897s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:22 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:24:22 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:22 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe 1G Jul 09 05:24:22 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:23 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" returned: 0 in 0.765s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-95b05ad9-ee0d-4572-a010-3c71bcddb5bd" released by "delete_volume" :: held 1.633s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:DELETE=20,cinder:SELECT=166,cinder:INSERT=69,cinder:UPDATE=231 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Created reservations ['21b2e0e9-5832-464e-aafa-dbb3ce016c05', '69efd0e7-b332-4d32-9f40-1c713f6fe20a', 'af043e43-9c4b-424c-b5cd-c82495d31e45', '4d7d6b0f-07db-4761-98f3-455825129e7a'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:23 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:24:23 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:23 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.776s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:24:23 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Deleted volume successfully. Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5824c76c-ecf5-4c39-a43e-fd83b34084fd tempest-ProjectReaderTests-1739331507 None] Lock "cinder-52a33c7c-6178-4247-b028-10b224bc33ae-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:23 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe 1G" returned: 0 in 1.005s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0959dc-6d8b-4641-a075-d99b805398ad -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:23 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0959dc-6d8b-4641-a075-d99b805398ad -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe Jul 09 05:24:23 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:24 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.753s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:24:24 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Deleted volume successfully. Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=165,cinder:INSERT=50,cinder:UPDATE=224,cinder:DELETE=16 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-349d22b6-2ee4-4b14-9883-511db2933d47 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-95b05ad9-ee0d-4572-a010-3c71bcddb5bd-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (c0f92675-39e6-4d54-a251-186b86c3489d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf5984e-1396-43c3-b497-e2d722f49dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf5984e-1396-43c3-b497-e2d722f49dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235584319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=102b7d4a-a9af-4275-9717-03be6380a498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:24Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b795f6-ce6b-4617-81ef-ebe0ed351393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b795f6-ce6b-4617-81ef-ebe0ed351393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8225800f-ac00-47d4-a9ca-622a6e623e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8225800f-ac00-47d4-a9ca-622a6e623e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '102b7d4a-a9af-4275-9717-03be6380a498', 'volume_name': 'volume-102b7d4a-a9af-4275-9717-03be6380a498', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2ef68c-ecda-4bdc-af41-4591a1dd6552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2ef68c-ecda-4bdc-af41-4591a1dd6552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64808f08-1a03-4fae-970b-d878c90a996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:24 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Volume 102b7d4a-a9af-4275-9717-03be6380a498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-102b7d4a-a9af-4275-9717-03be6380a498', 'volume_size': 1} Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:24 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0959dc-6d8b-4641-a075-d99b805398ad -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe" returned: 0 in 0.997s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:24 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe is being set with open permissions: ugo+rw Jul 09 05:24:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:24 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe Jul 09 05:24:24 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:25 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe" returned: 0 in 0.674s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:25 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.info Jul 09 05:24:25 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:26 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.info" returned: 0 in 0.639s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:26 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.info is being set with open permissions: ugo+rw Jul 09 05:24:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:26 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.info Jul 09 05:24:26 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:26 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.info" returned: 0 in 0.624s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.970s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.801s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Creating offline snapshot d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f of volume 3789aebf-faa3-461a-989a-74fd5cb834e0 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:24:26 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-585bd6c6-91ad-49d8-bf97-3687eaac1bf6 tempest-SnapshotDependencyTests-382873767 None] Create snapshot completed successfully Jul 09 05:24:26 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[17018cbe-7b3e-4cc9-9bec-57cd3ac04012]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:26 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 Jul 09 05:24:26 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:27 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0" returned: 0 in 0.837s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:27 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f 1G Jul 09 05:24:27 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Flow 'volume_create_manager' (ea460880-2147-48be-a717-40d50437972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93240ac-1d5d-4109-b453-032a1588a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93240ac-1d5d-4109-b453-032a1588a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c71917-e658-41a0-af58-6addf398c4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099cd7a432ab4e95aa0c0af5196b1b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd7a12d0-1486-4b27-aa39-4aab934215fe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:28Z,use_quota=True,user_id='e35a8122799f450a83619b3b05bac17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ce226d-ab8e-4eca-a7fa-399efa22b2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ce226d-ab8e-4eca-a7fa-399efa22b2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54ad2ed-8122-49ce-a1ad-111fb0527f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54ad2ed-8122-49ce-a1ad-111fb0527f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1c71917-e658-41a0-af58-6addf398c4fd', 'volume_name': 'volume-e1c71917-e658-41a0-af58-6addf398c4fd', 'volume_size': 1, 'snapshot_id': 'cd7a12d0-1486-4b27-aa39-4aab934215fe'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7d2af8-6092-480a-b48e-d0d6f5c28aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7d2af8-6092-480a-b48e-d0d6f5c28aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea3fc27-2688-4a72-b048-465a82aae814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:27 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Volume e1c71917-e658-41a0-af58-6addf398c4fd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1c71917-e658-41a0-af58-6addf398c4fd', 'volume_size': 1, 'snapshot_id': 'cd7a12d0-1486-4b27-aa39-4aab934215fe'} Jul 09 05:24:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:28 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f 1G" returned: 0 in 0.943s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3789aebf-faa3-461a-989a-74fd5cb834e0 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:28 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3789aebf-faa3-461a-989a-74fd5cb834e0 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f Jul 09 05:24:28 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:29 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3789aebf-faa3-461a-989a-74fd5cb834e0 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f" returned: 0 in 0.734s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:29 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f is being set with open permissions: ugo+rw Jul 09 05:24:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:29 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f Jul 09 05:24:29 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:30 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f" returned: 0 in 0.719s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:30 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.info Jul 09 05:24:30 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:30 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.info" returned: 0 in 0.653s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:30 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.info is being set with open permissions: ugo+rw Jul 09 05:24:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:30 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.info Jul 09 05:24:30 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:31 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.info" returned: 0 in 0.639s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.650s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.829s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235584319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=102b7d4a-a9af-4275-9717-03be6380a498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:24Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Creating volume 102b7d4a-a9af-4275-9717-03be6380a498 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:24:31 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:24:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:31 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 1073741824 Jul 09 05:24:31 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9cd09b2b-38f1-4c27-a705-bd771dfef49f tempest-ProjectReaderTests-445434748 None] Create snapshot completed successfully Jul 09 05:24:32 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 1073741824" returned: 0 in 0.897s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:32 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 Jul 09 05:24:32 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Lock "cinder-d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-3789aebf-faa3-461a-989a-74fd5cb834e0" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-3789aebf-faa3-461a-989a-74fd5cb834e0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Deleting offline snapshot d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f of volume 3789aebf-faa3-461a-989a-74fd5cb834e0 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] snapshot_file for this snap is: volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc51c431-6089-4a4c-b181-330f361260ad]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:32 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f Jul 09 05:24:32 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:33 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498" returned: 0 in 0.765s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.284s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "cinder-quobyte-cd7a12d0-1486-4b27-aa39-4aab934215fe-e1c71917-e658-41a0-af58-6addf398c4fd" by "_create_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64808f08-1a03-4fae-970b-d878c90a996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-102b7d4a-a9af-4275-9717-03be6380a498', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0547515e-a877-4ca3-8587-08a05d396725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-cd7a12d0-1486-4b27-aa39-4aab934215fe-e1c71917-e658-41a0-af58-6addf398c4fd" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Creating volume e1c71917-e658-41a0-af58-6addf398c4fd from snapshot cd7a12d0-1486-4b27-aa39-4aab934215fe {{(pid=87161) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "cinder-quobyte-e1c71917-e658-41a0-af58-6addf398c4fd" by "_copy_volume_from_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-e1c71917-e658-41a0-af58-6addf398c4fd" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] snapshot: cd7a12d0-1486-4b27-aa39-4aab934215fe, volume: e1c71917-e658-41a0-af58-6addf398c4fd, {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 05:24:33 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Volume volume-102b7d4a-a9af-4275-9717-03be6380a498 (102b7d4a-a9af-4275-9717-03be6380a498): created successfully Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0547515e-a877-4ca3-8587-08a05d396725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (c0f92675-39e6-4d54-a251-186b86c3489d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:33 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-12a111f5-b3ee-49af-a50d-039d88b19d42 tempest-ProjectMemberTests-1563098389 None] Created volume successfully. Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f99505-a260-4948-943d-3613c064b441]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:33 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f" returned: 0 in 0.826s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3789aebf-faa3-461a-989a-74fd5cb834e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf34cfa5-db91-4e11-ad3b-36595c807c07]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:33 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe Jul 09 05:24:33 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:33 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 Jul 09 05:24:33 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:34 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe" returned: 0 in 0.883s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f0959dc-6d8b-4641-a075-d99b805398ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] will copy from snapshot at /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Creating direct copy from snapshot {{(pid=87161) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 05:24:34 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff94bf7-910c-4c1b-ab20-59085d4e0a10]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0" returned: 0 in 0.845s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:34 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f Jul 09 05:24:34 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:34 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad Jul 09 05:24:34 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:34 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:35 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f Jul 09 05:24:35 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:35 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad" returned: 0 in 0.895s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:35 devstack cinder-volume[87161]: DEBUG cinder.utils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Path /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd not found in is_blk_device check {{(pid=87161) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 05:24:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:35 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd Jul 09 05:24:35 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:35 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0.d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f" returned: 0 in 0.702s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f" released by "_delete_snapshot" :: held 3.280s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-3789aebf-faa3-461a-989a-74fd5cb834e0" released by "delete_snapshot" :: held 3.301s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:35 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Created reservations ['206ce074-37c7-4cfb-b63c-06433f6524fb', '3d253340-c4bc-4e05-ae66-a9ede0f2949f', 'ee5dd718-e599-41ef-b449-959248e715c0', '480444ba-b133-4c4c-bdbb-1298d7c08efb'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:35 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Delete snapshot completed successfully. Jul 09 05:24:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7eed5364-7ee8-446b-8ded-4c8d529d531f tempest-ProjectReaderTests-445434748 None] Lock "cinder-d215a8eb-b3f9-4b31-9e1f-bd24751a0d9f-delete_snapshot" released by "delete_snapshot" :: held 3.477s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-3789aebf-faa3-461a-989a-74fd5cb834e0-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Lock "cinder-3789aebf-faa3-461a-989a-74fd5cb834e0-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-3789aebf-faa3-461a-989a-74fd5cb834e0" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-3789aebf-faa3-461a-989a-74fd5cb834e0" acquired by "delete_volume" :: waited 0.051s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:37 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4838550-445e-4de5-b378-2c3e61b549cf]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:37 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 Jul 09 05:24:37 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:38 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0" returned: 0 in 1.355s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:38 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0 Jul 09 05:24:38 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:24:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:39 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:24:39 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:40 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-3789aebf-faa3-461a-989a-74fd5cb834e0" returned: 0 in 1.532s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-3789aebf-faa3-461a-989a-74fd5cb834e0" released by "delete_volume" :: held 3.060s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Created reservations ['a2717293-d2e0-4c1e-8ad8-96792e7a466e', '36b02a88-d765-4c8e-a357-a0f53e868a46', '47e4c3da-f334-4ac1-8f12-331bf6da6dba', 'fd87627b-ab26-40bf-9e44-262e546062ce'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:40 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:24:40 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:40 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.573s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:24:40 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:24:41 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd" returned: 0 in 6.070s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:41 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b606ac-50a3-4e93-a123-ebacbb9616a1]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:41 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad Jul 09 05:24:41 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:41 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 1.045s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:41 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:24:41 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Deleted volume successfully. Jul 09 05:24:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-2cac6697-dc66-40a7-a745-7e72c4d114e1 tempest-ProjectReaderTests-445434748 None] Lock "cinder-3789aebf-faa3-461a-989a-74fd5cb834e0-delete_volume" released by "delete_volume" :: held 4.771s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:41 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:24:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Flow 'volume_create_manager' (215f44e2-e833-4f80-82bb-968c3e4aace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d3847f-3dd2-4f1f-b3e1-131145245294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d3847f-3dd2-4f1f-b3e1-131145245294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1700713552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da6372e-e81a-4982-9d81-d4aac85f3371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb037b13cb1e4ee3afc5959e5963e9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:42Z,use_quota=True,user_id='5dc6396280eb4bbeaee76f0cc689374c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd739da-20fe-4f18-bb5c-0be5eff95f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd739da-20fe-4f18-bb5c-0be5eff95f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6278e434-4768-48fb-b9a8-3e2f720fb6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6278e434-4768-48fb-b9a8-3e2f720fb6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da6372e-e81a-4982-9d81-d4aac85f3371', 'volume_name': 'volume-5da6372e-e81a-4982-9d81-d4aac85f3371', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f7d833-1422-4b78-9034-b4cd1ecdc466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f7d833-1422-4b78-9034-b4cd1ecdc466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8327b1-0938-4d2f-a961-161d52423a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Volume 5da6372e-e81a-4982-9d81-d4aac85f3371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da6372e-e81a-4982-9d81-d4aac85f3371', 'volume_size': 1} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:42 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad" returned: 0 in 1.067s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.image.image_utils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Image conversion details: src /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd {{(pid=87161) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 05:24:42 devstack cinder-volume[87161]: INFO cinder.image.image_utils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Converted 1024.00 MB image at 168.67 MB/s Jul 09 05:24:42 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd is being set with open permissions: ugo+rw Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:42 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd Jul 09 05:24:42 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:42 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd" returned: 0 in 0.673s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-e1c71917-e658-41a0-af58-6addf398c4fd" released by "_copy_volume_from_snapshot" :: held 9.729s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-cd7a12d0-1486-4b27-aa39-4aab934215fe-e1c71917-e658-41a0-af58-6addf398c4fd" released by "_create_volume_from_snapshot" :: held 9.764s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.802s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.520s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Creating offline snapshot ccc1e082-6c18-455f-95fc-8b880e5f484a of volume 102b7d4a-a9af-4275-9717-03be6380a498 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea3fc27-2688-4a72-b048-465a82aae814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c71917-e658-41a0-af58-6addf398c4fd', 'volume_size': 1, 'snapshot_id': 'cd7a12d0-1486-4b27-aa39-4aab934215fe'}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a5db04-facf-4e5e-91e5-4c18d1ff035b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[83661e1d-9d56-4fd8-9a17-59a3b74da47b]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Volume volume-e1c71917-e658-41a0-af58-6addf398c4fd (e1c71917-e658-41a0-af58-6addf398c4fd): created successfully Jul 09 05:24:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a5db04-facf-4e5e-91e5-4c18d1ff035b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Flow 'volume_create_manager' (ea460880-2147-48be-a717-40d50437972f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:43 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f40753dc-10e2-45f1-ac8d-7bb5feb05258 tempest-SnapshotDependencyTests-382873767 None] Created volume successfully. Jul 09 05:24:43 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 Jul 09 05:24:43 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "cinder-cd7a12d0-1486-4b27-aa39-4aab934215fe-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-cd7a12d0-1486-4b27-aa39-4aab934215fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "cinder-quobyte-9f0959dc-6d8b-4641-a075-d99b805398ad" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-9f0959dc-6d8b-4641-a075-d99b805398ad" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "cinder-quobyte-cd7a12d0-1486-4b27-aa39-4aab934215fe" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-cd7a12d0-1486-4b27-aa39-4aab934215fe" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Deleting offline snapshot cd7a12d0-1486-4b27-aa39-4aab934215fe of volume 9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] snapshot_file for this snap is: volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1859c156-07e9-409a-b552-a8342a798aa9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:43 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe Jul 09 05:24:43 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:43 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498" returned: 0 in 0.750s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:43 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a 1G Jul 09 05:24:43 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:44 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe" returned: 0 in 0.764s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:44 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f0959dc-6d8b-4641-a075-d99b805398ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:24:44 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aae551b-d725-4bec-bf1a-eeda21e74574]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:44 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad Jul 09 05:24:44 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:44 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a 1G" returned: 0 in 0.835s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-102b7d4a-a9af-4275-9717-03be6380a498 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:44 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-102b7d4a-a9af-4275-9717-03be6380a498 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a Jul 09 05:24:44 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:44 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad" returned: 0 in 0.756s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:44 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe Jul 09 05:24:44 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:45 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-102b7d4a-a9af-4275-9717-03be6380a498 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a" returned: 0 in 0.659s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:45 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a is being set with open permissions: ugo+rw Jul 09 05:24:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:45 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a Jul 09 05:24:45 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:45 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe" returned: 0 in 0.720s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:45 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe Jul 09 05:24:45 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:45 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a" returned: 0 in 0.638s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:45 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.info Jul 09 05:24:45 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:46 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad.cd7a12d0-1486-4b27-aa39-4aab934215fe" returned: 0 in 0.693s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-cd7a12d0-1486-4b27-aa39-4aab934215fe" released by "_delete_snapshot" :: held 3.034s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-9f0959dc-6d8b-4641-a075-d99b805398ad" released by "delete_snapshot" :: held 3.060s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:46 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Created reservations ['e30add0f-f0da-4d43-b081-41bc1e9a88f6', 'e0971250-bd36-41e7-a382-40c9fc0f6149', 'fc7801f6-a15e-4a9f-8ab0-8910147e049d', 'de2f926b-dccd-4cb8-94f6-ad3ea8cb4b5e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:46 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Delete snapshot completed successfully. Jul 09 05:24:46 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e2eec970-ba1b-4492-9748-fa980f391b1d tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-cd7a12d0-1486-4b27-aa39-4aab934215fe-delete_snapshot" released by "delete_snapshot" :: held 3.207s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:46 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.info" returned: 0 in 0.672s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:46 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.info is being set with open permissions: ugo+rw Jul 09 05:24:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:46 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.info Jul 09 05:24:46 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:47 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.info" returned: 0 in 0.656s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.310s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.173s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1700713552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da6372e-e81a-4982-9d81-d4aac85f3371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb037b13cb1e4ee3afc5959e5963e9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:42Z,use_quota=True,user_id='5dc6396280eb4bbeaee76f0cc689374c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Creating volume 5da6372e-e81a-4982-9d81-d4aac85f3371 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:24:47 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:47 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 1073741824 Jul 09 05:24:47 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:47 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d0f204d3-6b54-4bca-aa81-24efa69b2f23 tempest-ProjectMemberTests-1563098389 None] Create snapshot completed successfully Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "cinder-9f0959dc-6d8b-4641-a075-d99b805398ad-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-9f0959dc-6d8b-4641-a075-d99b805398ad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "cinder-quobyte-9f0959dc-6d8b-4641-a075-d99b805398ad" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-9f0959dc-6d8b-4641-a075-d99b805398ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bd765c-a818-4139-a5e3-91ac343a68d6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:47 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad Jul 09 05:24:47 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:48 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 1073741824" returned: 0 in 0.806s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:48 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 Jul 09 05:24:48 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-ccc1e082-6c18-455f-95fc-8b880e5f484a-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-ccc1e082-6c18-455f-95fc-8b880e5f484a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-102b7d4a-a9af-4275-9717-03be6380a498" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-102b7d4a-a9af-4275-9717-03be6380a498" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-ccc1e082-6c18-455f-95fc-8b880e5f484a" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-ccc1e082-6c18-455f-95fc-8b880e5f484a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Deleting offline snapshot ccc1e082-6c18-455f-95fc-8b880e5f484a of volume 102b7d4a-a9af-4275-9717-03be6380a498 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] snapshot_file for this snap is: volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc059ea-0bf4-4dba-bc65-0bbea144de87]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:48 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad" returned: 0 in 0.858s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:48 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad Jul 09 05:24:48 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:48 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a Jul 09 05:24:48 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:48 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371" returned: 0 in 0.709s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8327b1-0938-4d2f-a961-161d52423a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da6372e-e81a-4982-9d81-d4aac85f3371', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056bcbee-f43e-4725-9856-4569233aed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:48 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Volume volume-5da6372e-e81a-4982-9d81-d4aac85f3371 (5da6372e-e81a-4982-9d81-d4aac85f3371): created successfully Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056bcbee-f43e-4725-9856-4569233aed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:48 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Flow 'volume_create_manager' (215f44e2-e833-4f80-82bb-968c3e4aace3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:48 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d87aeaa7-eb3d-47a0-93ca-c9d7eae99849 tempest-ProjectReaderTests-445434748 None] Created volume successfully. Jul 09 05:24:49 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-9f0959dc-6d8b-4641-a075-d99b805398ad" returned: 0 in 0.688s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-9f0959dc-6d8b-4641-a075-d99b805398ad" released by "delete_volume" :: held 1.612s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:49 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Created reservations ['1e4b558d-1e7d-494d-9287-da5141e61af1', 'f59668c7-4a09-4444-8fcc-2f5b42506057', 'b531fed1-7e92-4410-9d5c-9af61aa34e41', '17fedf92-e487-46f0-90fa-49d42254394b'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a" returned: 0 in 0.829s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-102b7d4a-a9af-4275-9717-03be6380a498(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[929539be-d120-4556-a8d9-f3689e85595e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:49 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:24:49 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:49 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 Jul 09 05:24:49 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Creating offline snapshot a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 of volume 5da6372e-e81a-4982-9d81-d4aac85f3371 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9415e988-f2ab-409a-ac17-c66ece5f0e9c]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:49 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 Jul 09 05:24:49 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "cinder-e1c71917-e658-41a0-af58-6addf398c4fd-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-e1c71917-e658-41a0-af58-6addf398c4fd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "cinder-quobyte-e1c71917-e658-41a0-af58-6addf398c4fd" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-e1c71917-e658-41a0-af58-6addf398c4fd" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd55be79-a01b-498f-af50-35117ecf444e]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:50 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd Jul 09 05:24:50 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:50 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.774s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:24:50 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498" returned: 0 in 0.883s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:50 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Deleted volume successfully. Jul 09 05:24:50 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a Jul 09 05:24:50 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-5704a44f-3cd6-4ed8-a2ab-d98021c6aa2a tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-9f0959dc-6d8b-4641-a075-d99b805398ad-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:50 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371" returned: 0 in 0.843s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:50 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 1G Jul 09 05:24:50 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:50 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd" returned: 0 in 0.841s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:50 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd Jul 09 05:24:50 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:50 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a" returned: 0 in 0.783s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:50 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a Jul 09 05:24:50 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:51 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 1G" returned: 0 in 0.836s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da6372e-e81a-4982-9d81-d4aac85f3371 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:51 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da6372e-e81a-4982-9d81-d4aac85f3371 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 Jul 09 05:24:51 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:51 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e1c71917-e658-41a0-af58-6addf398c4fd" returned: 0 in 0.725s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-quobyte-e1c71917-e658-41a0-af58-6addf398c4fd" released by "delete_volume" :: held 1.615s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Created reservations ['c2c6f358-ab6a-45d2-9470-f8cd4ad3dff2', 'c096baf9-d8bb-4274-b0f2-174d97cd396a', '97721bfc-d4d6-419d-8f88-8adb431f1ba1', '0e911787-5cb5-4f30-973f-44bcc737000a'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:51 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498.ccc1e082-6c18-455f-95fc-8b880e5f484a" returned: 0 in 0.718s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:51 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:24:51 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-ccc1e082-6c18-455f-95fc-8b880e5f484a" released by "_delete_snapshot" :: held 3.332s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-102b7d4a-a9af-4275-9717-03be6380a498" released by "delete_snapshot" :: held 3.356s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Created reservations ['de5aa294-08fa-4c08-8fe6-93f02fcbebb8', '0aab5fb7-5765-4bf8-8e18-f53e3aefac87', 'ff727a32-9ef5-4dc3-9f9e-8f63b375cbbf', 'e30faf6c-03ec-4632-ba81-e5f56369b8ea'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Delete snapshot completed successfully. Jul 09 05:24:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-ab3d9ca2-51d3-42fd-a004-f97880e7e003 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-ccc1e082-6c18-455f-95fc-8b880e5f484a-delete_snapshot" released by "delete_snapshot" :: held 3.504s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:52 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da6372e-e81a-4982-9d81-d4aac85f3371 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839" returned: 0 in 0.797s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:52 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 is being set with open permissions: ugo+rw Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:52 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 Jul 09 05:24:52 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:52 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.643s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:24:52 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Deleted volume successfully. Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-e56e4619-ce18-4beb-8273-de0033a47ff6 tempest-SnapshotDependencyTests-382873767 None] Lock "cinder-e1c71917-e658-41a0-af58-6addf398c4fd-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-102b7d4a-a9af-4275-9717-03be6380a498-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-102b7d4a-a9af-4275-9717-03be6380a498-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-102b7d4a-a9af-4275-9717-03be6380a498" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-102b7d4a-a9af-4275-9717-03be6380a498" acquired by "delete_volume" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[864313c1-b3e3-4ad8-a6ca-d4111ce72b7d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:52 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 Jul 09 05:24:52 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:52 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839" returned: 0 in 0.774s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:52 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.info Jul 09 05:24:52 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:53 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.info" returned: 0 in 0.643s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:53 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.info is being set with open permissions: ugo+rw Jul 09 05:24:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:53 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498" returned: 0 in 0.882s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:53 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.info Jul 09 05:24:53 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:53 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498 Jul 09 05:24:53 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:54 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.info" returned: 0 in 0.684s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.691s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:54 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-102b7d4a-a9af-4275-9717-03be6380a498" returned: 0 in 0.691s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-102b7d4a-a9af-4275-9717-03be6380a498" released by "delete_volume" :: held 1.653s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:54 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b3d31448-1d64-4d3c-893c-d47c3c5efd3c tempest-ProjectReaderTests-445434748 None] Create snapshot completed successfully Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Created reservations ['2d1c4c9f-006d-4ffb-8bf0-5e449e203afa', 'b0299070-9ef3-4b18-ab8e-390f325f72a5', 'a9f53e98-ae85-4f14-a38b-00ef36b9dd32', '7cab94d7-6df9-478b-8811-c827d9d14b21'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:54 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:24:54 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Lock "cinder-a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-5da6372e-e81a-4982-9d81-d4aac85f3371" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-5da6372e-e81a-4982-9d81-d4aac85f3371" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Deleting offline snapshot a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 of volume 5da6372e-e81a-4982-9d81-d4aac85f3371 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] snapshot_file for this snap is: volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0a1184-181a-4ce1-ba62-f2c1f53e679d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:55 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 Jul 09 05:24:55 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:55 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.811s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:24:55 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Deleted volume successfully. Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9490da8e-b320-4d96-b0cc-9705387f10e7 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-102b7d4a-a9af-4275-9717-03be6380a498-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (e6d193a5-5083-4dca-b693-e1abcb996229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312efe1c-7a0e-4c33-9ec9-ed2bb136473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312efe1c-7a0e-4c33-9ec9-ed2bb136473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587396325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49c6818-83ba-4e5c-87d5-3549ebd865c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:55Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b47af35-f933-475c-873b-ecc364b5bb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b47af35-f933-475c-873b-ecc364b5bb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ec1bd4-6083-4722-b31e-bea658391cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ec1bd4-6083-4722-b31e-bea658391cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49c6818-83ba-4e5c-87d5-3549ebd865c4', 'volume_name': 'volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a099fc78-8e41-4ed8-adf8-55b77e8ffbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a099fc78-8e41-4ed8-adf8-55b77e8ffbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8013144-2bb9-4c2f-a478-93396934f555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:55 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Volume d49c6818-83ba-4e5c-87d5-3549ebd865c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4', 'volume_size': 1} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587396325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49c6818-83ba-4e5c-87d5-3549ebd865c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:24:55Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Creating volume d49c6818-83ba-4e5c-87d5-3549ebd865c4 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:24:55 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:24:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:55 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 1073741824 Jul 09 05:24:55 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:56 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839" returned: 0 in 0.975s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:56 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da6372e-e81a-4982-9d81-d4aac85f3371(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:24:56 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fefaee5-5f24-4339-9f8d-5488c2c7ac01]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:56 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 Jul 09 05:24:56 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:56 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 1073741824" returned: 0 in 0.996s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:56 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 Jul 09 05:24:56 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:56 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371" returned: 0 in 0.826s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:56 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 Jul 09 05:24:56 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:57 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4" returned: 0 in 0.703s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8013144-2bb9-4c2f-a478-93396934f555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47af40b6-87f8-4997-baf3-6f5821db727f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:24:57 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Volume volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 (d49c6818-83ba-4e5c-87d5-3549ebd865c4): created successfully Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47af40b6-87f8-4997-baf3-6f5821db727f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (e6d193a5-5083-4dca-b693-e1abcb996229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:24:57 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d5508e0b-718e-4acf-88e9-1c57f638ee14 tempest-ProjectMemberTests-1563098389 None] Created volume successfully. Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Creating offline snapshot 082c8ff6-ea18-478c-b6c9-da6e2494313c of volume d49c6818-83ba-4e5c-87d5-3549ebd865c4 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:24:57 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839" returned: 0 in 0.912s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bcda6b-ef7d-40af-a2c9-fa63747e8760]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:57 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839 Jul 09 05:24:57 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:57 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 Jul 09 05:24:57 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:58 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371.a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839" returned: 0 in 0.740s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839" released by "_delete_snapshot" :: held 3.592s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-5da6372e-e81a-4982-9d81-d4aac85f3371" released by "delete_snapshot" :: held 3.619s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:58 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Created reservations ['5026a10d-134c-4c7d-ab8d-bf9d04ff90e7', '4bb04fc6-b7f5-4447-ba28-309cee113fcf', '367498f5-5694-4aa2-891c-eec6394a4cdc', 'a6dd7401-b4b5-4d36-9822-0376b2d2d0b6'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:24:58 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4" returned: 0 in 0.839s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:58 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c 1G Jul 09 05:24:58 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:58 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Delete snapshot completed successfully. Jul 09 05:24:58 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d92356e3-4859-40fc-9ecb-fd47e5980360 tempest-ProjectReaderTests-445434748 None] Lock "cinder-a2d2f378-c1c3-4fa7-9f82-e6ac2cb3b839-delete_snapshot" released by "delete_snapshot" :: held 3.847s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:24:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-5da6372e-e81a-4982-9d81-d4aac85f3371-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Lock "cinder-5da6372e-e81a-4982-9d81-d4aac85f3371-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-5da6372e-e81a-4982-9d81-d4aac85f3371" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:24:59 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-5da6372e-e81a-4982-9d81-d4aac85f3371" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:24:59 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd8997d-a1cf-419a-9da5-60bb0cbfd15b]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:24:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:59 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 Jul 09 05:24:59 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:24:59 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 09 05:24:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c 1G" returned: 0 in 0.941s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:24:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:24:59 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c Jul 09 05:24:59 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:00 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371" returned: 0 in 0.895s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:00 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371 Jul 09 05:25:00 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:00 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c" returned: 0 in 0.832s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:00 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c is being set with open permissions: ugo+rw Jul 09 05:25:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:00 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c Jul 09 05:25:00 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:00 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-5da6372e-e81a-4982-9d81-d4aac85f3371" returned: 0 in 0.723s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-5da6372e-e81a-4982-9d81-d4aac85f3371" released by "delete_volume" :: held 1.690s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:01 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Created reservations ['c3979619-36b8-48ec-9efb-5e95392756b5', '32676aae-eb88-4b2b-a71e-0c243f59929a', '897aecd6-a5f4-48d2-acac-604e9ea0e58a', '16dc8acc-3432-43ac-a8f0-a4c3e055418c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:01 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:25:01 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:01 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c" returned: 0 in 0.778s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:01 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.info Jul 09 05:25:01 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:01 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.908s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:25:02 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Deleted volume successfully. Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Flow 'volume_create_manager' (cf607e16-9cdf-4e78-8c19-105b961a9a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48500be1-afaf-4191-95ad-ff7a4928dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-97af7d7e-d13a-439a-a2de-2192db5240f2 tempest-ProjectReaderTests-445434748 None] Lock "cinder-5da6372e-e81a-4982-9d81-d4aac85f3371-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48500be1-afaf-4191-95ad-ff7a4928dda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180283647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21418919-1a49-480d-891b-a1bf52a96f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb037b13cb1e4ee3afc5959e5963e9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:02Z,use_quota=True,user_id='5dc6396280eb4bbeaee76f0cc689374c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b8ee5f-ccf2-4a96-aeeb-0d651784ea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b8ee5f-ccf2-4a96-aeeb-0d651784ea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f5cbaa-902b-4825-bcef-943c0520fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f5cbaa-902b-4825-bcef-943c0520fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21418919-1a49-480d-891b-a1bf52a96f01', 'volume_name': 'volume-21418919-1a49-480d-891b-a1bf52a96f01', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b495df-0338-4ade-b52a-83d37bbcb3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b495df-0338-4ade-b52a-83d37bbcb3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b74845e-45b8-4d94-affb-af770c288ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:02 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Volume 21418919-1a49-480d-891b-a1bf52a96f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21418919-1a49-480d-891b-a1bf52a96f01', 'volume_size': 1} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:02 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.info" returned: 0 in 0.968s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:02 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.info is being set with open permissions: ugo+rw Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:02 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.info Jul 09 05:25:02 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:02 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.info" returned: 0 in 0.688s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.148s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.762s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180283647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21418919-1a49-480d-891b-a1bf52a96f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb037b13cb1e4ee3afc5959e5963e9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:02Z,use_quota=True,user_id='5dc6396280eb4bbeaee76f0cc689374c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Creating volume 21418919-1a49-480d-891b-a1bf52a96f01 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:25:02 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:25:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:02 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 1073741824 Jul 09 05:25:02 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:02 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4ba1a6d5-0527-4ae1-a59a-162271c17a19 tempest-ProjectMemberTests-1563098389 None] Create snapshot completed successfully Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-082c8ff6-ea18-478c-b6c9-da6e2494313c-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-082c8ff6-ea18-478c-b6c9-da6e2494313c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-d49c6818-83ba-4e5c-87d5-3549ebd865c4" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-d49c6818-83ba-4e5c-87d5-3549ebd865c4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-082c8ff6-ea18-478c-b6c9-da6e2494313c" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-082c8ff6-ea18-478c-b6c9-da6e2494313c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Deleting offline snapshot 082c8ff6-ea18-478c-b6c9-da6e2494313c of volume d49c6818-83ba-4e5c-87d5-3549ebd865c4 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] snapshot_file for this snap is: volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbd0aa1-b7c6-4d24-be42-7fe8013bf917]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:03 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c Jul 09 05:25:03 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:03 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 1073741824" returned: 0 in 0.840s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:03 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 Jul 09 05:25:03 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:03 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c" returned: 0 in 0.781s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba1bcb8-a079-4eac-99d3-2665298490b4]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:04 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 Jul 09 05:25:04 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:04 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01" returned: 0 in 0.671s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:04 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:25:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b74845e-45b8-4d94-affb-af770c288ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21418919-1a49-480d-891b-a1bf52a96f01', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be401ac-6c67-4880-b07b-48ca7a977f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:04 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Volume volume-21418919-1a49-480d-891b-a1bf52a96f01 (21418919-1a49-480d-891b-a1bf52a96f01): created successfully Jul 09 05:25:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be401ac-6c67-4880-b07b-48ca7a977f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:04 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Flow 'volume_create_manager' (cf607e16-9cdf-4e78-8c19-105b961a9a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-f7f4f633-d374-4212-91cd-a8f5058e0da1 tempest-ProjectReaderTests-445434748 None] Created volume successfully. Jul 09 05:25:04 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4" returned: 0 in 0.765s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:04 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c Jul 09 05:25:04 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:05 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Creating offline snapshot 7c6485f5-a190-4855-9ef8-649d96242c2a of volume 21418919-1a49-480d-891b-a1bf52a96f01 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:25:05 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[246bfe86-e9bf-48f9-90ec-b7b2bd08d879]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:05 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 Jul 09 05:25:05 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:05 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c" returned: 0 in 0.763s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:05 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c Jul 09 05:25:05 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:06 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01" returned: 0 in 0.780s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:06 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a 1G Jul 09 05:25:06 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:06 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4.082c8ff6-ea18-478c-b6c9-da6e2494313c" returned: 0 in 0.643s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-082c8ff6-ea18-478c-b6c9-da6e2494313c" released by "_delete_snapshot" :: held 3.044s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-d49c6818-83ba-4e5c-87d5-3549ebd865c4" released by "delete_snapshot" :: held 3.063s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:06 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Created reservations ['dc517ba1-b917-49e6-9a39-e6b78a07672d', '6ffb6c76-f5a3-4da9-a1e8-583b17d51f39', '9dcb6eac-e9f1-461c-b508-2812f2a66df5', 'e58160cf-4c2b-4864-a736-6e8500a0b426'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:06 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Delete snapshot completed successfully. Jul 09 05:25:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-7baf87ce-ec6e-4d6b-bb16-90208afd1e77 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-082c8ff6-ea18-478c-b6c9-da6e2494313c-delete_snapshot" released by "delete_snapshot" :: held 3.222s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:06 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a 1G" returned: 0 in 0.800s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21418919-1a49-480d-891b-a1bf52a96f01 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:06 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21418919-1a49-480d-891b-a1bf52a96f01 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a Jul 09 05:25:06 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-d49c6818-83ba-4e5c-87d5-3549ebd865c4-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-d49c6818-83ba-4e5c-87d5-3549ebd865c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-d49c6818-83ba-4e5c-87d5-3549ebd865c4" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-d49c6818-83ba-4e5c-87d5-3549ebd865c4" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:07 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e626643-1589-459f-9000-dd2d6101a612]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:07 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21418919-1a49-480d-891b-a1bf52a96f01 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a" returned: 0 in 0.708s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:07 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a is being set with open permissions: ugo+rw Jul 09 05:25:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:07 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 Jul 09 05:25:07 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:07 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a Jul 09 05:25:07 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:08 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a" returned: 0 in 0.627s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:08 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4" returned: 0 in 0.773s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:08 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.info Jul 09 05:25:08 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:08 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4 Jul 09 05:25:08 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:08 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.info" returned: 0 in 0.638s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:08 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.info is being set with open permissions: ugo+rw Jul 09 05:25:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:08 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.info Jul 09 05:25:08 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:08 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:08 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-d49c6818-83ba-4e5c-87d5-3549ebd865c4" returned: 0 in 0.666s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:08 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-d49c6818-83ba-4e5c-87d5-3549ebd865c4" released by "delete_volume" :: held 1.499s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:08 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Created reservations ['a20820e1-e234-4b3c-991a-dfb401ca7a2a', '13af1987-73e5-48ff-861d-d3f8473b468b', '2a9600a3-237e-421d-93e9-960b717654a0', '93e9ac37-6e44-493c-b051-5fae4d04c8e9'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:09 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:25:09 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:09 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.info" returned: 0 in 0.638s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.289s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b757a4fd-af20-4fef-b6ca-b15b1dcc02f8 tempest-ProjectReaderTests-445434748 None] Create snapshot completed successfully Jul 09 05:25:09 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.678s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:25:09 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Deleted volume successfully. Jul 09 05:25:09 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-891f2228-facb-4f56-960c-4929bae29865 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-d49c6818-83ba-4e5c-87d5-3549ebd865c4-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (8db62236-73b2-493f-a605-26f543d4fdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228c5889-e597-472b-9f95-32771b9fd905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228c5889-e597-472b-9f95-32771b9fd905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1690225287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a80b1f-c0cb-4c52-aa02-af6504e3fa06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:10Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4d1b08-c7af-4e7e-871f-75bb705f1a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4d1b08-c7af-4e7e-871f-75bb705f1a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a0d0f0-6102-4a38-8e55-5d2a81c894dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a0d0f0-6102-4a38-8e55-5d2a81c894dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a80b1f-c0cb-4c52-aa02-af6504e3fa06', 'volume_name': 'volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf47d3b-af40-4a84-ab83-d66aa3364593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf47d3b-af40-4a84-ab83-d66aa3364593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4d92ea-29fc-443e-a42b-02af3cbafc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:10 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Volume 54a80b1f-c0cb-4c52-aa02-af6504e3fa06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06', 'volume_size': 1} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1690225287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a80b1f-c0cb-4c52-aa02-af6504e3fa06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:10Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Creating volume 54a80b1f-c0cb-4c52-aa02-af6504e3fa06 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:25:10 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:10 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 1073741824 Jul 09 05:25:10 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-7c6485f5-a190-4855-9ef8-649d96242c2a-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Lock "cinder-7c6485f5-a190-4855-9ef8-649d96242c2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-21418919-1a49-480d-891b-a1bf52a96f01" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-21418919-1a49-480d-891b-a1bf52a96f01" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-7c6485f5-a190-4855-9ef8-649d96242c2a" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-7c6485f5-a190-4855-9ef8-649d96242c2a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Deleting offline snapshot 7c6485f5-a190-4855-9ef8-649d96242c2a of volume 21418919-1a49-480d-891b-a1bf52a96f01 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] snapshot_file for this snap is: volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7122a984-ee53-4b44-9965-4571207ee743]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:10 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a Jul 09 05:25:10 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:10 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 1073741824" returned: 0 in 0.822s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:10 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:11 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 Jul 09 05:25:11 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:11 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a" returned: 0 in 0.770s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21418919-1a49-480d-891b-a1bf52a96f01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[46948e20-dab2-4b55-b137-3ed042dae506]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:11 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 Jul 09 05:25:11 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:11 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" returned: 0 in 0.646s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4d92ea-29fc-443e-a42b-02af3cbafc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20be76c-ae11-4ff0-8f8e-831f8fc9147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:11 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Volume volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 (54a80b1f-c0cb-4c52-aa02-af6504e3fa06): created successfully Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20be76c-ae11-4ff0-8f8e-831f8fc9147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:11 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (8db62236-73b2-493f-a605-26f543d4fdf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:11 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-917e15f7-7b1a-45d4-bdb1-22388fbb241d tempest-ProjectMemberTests-1563098389 None] Created volume successfully. Jul 09 05:25:12 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01" returned: 0 in 0.808s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:12 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a Jul 09 05:25:12 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:12 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Creating offline snapshot fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 of volume 54a80b1f-c0cb-4c52-aa02-af6504e3fa06 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:25:12 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f4731a-3aad-4896-a913-5d60a4c3e874]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:12 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 Jul 09 05:25:12 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:12 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a" returned: 0 in 0.733s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:12 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:12 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a Jul 09 05:25:12 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:13 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" returned: 0 in 0.775s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:13 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 1G Jul 09 05:25:13 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:13 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01.7c6485f5-a190-4855-9ef8-649d96242c2a" returned: 0 in 0.652s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-7c6485f5-a190-4855-9ef8-649d96242c2a" released by "_delete_snapshot" :: held 3.055s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-21418919-1a49-480d-891b-a1bf52a96f01" released by "delete_snapshot" :: held 3.080s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:13 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Created reservations ['e35d61d4-40e5-45dc-8ce3-a81e5eedb707', '1bdaab3b-500c-4024-a3e3-e63f0a12cc0f', '0e91bf3b-7b75-4354-81c6-6a8c1bac449c', 'bdcbc164-7951-4591-9533-8cb67691a8db'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:13 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Delete snapshot completed successfully. Jul 09 05:25:13 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4e891157-b5d1-4fb6-92d8-023ce112e84a tempest-ProjectReaderTests-445434748 None] Lock "cinder-7c6485f5-a190-4855-9ef8-649d96242c2a-delete_snapshot" released by "delete_snapshot" :: held 3.221s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:13 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 1G" returned: 0 in 0.788s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:13 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:13 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 Jul 09 05:25:13 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:14 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2" returned: 0 in 0.695s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:14 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 is being set with open permissions: ugo+rw Jul 09 05:25:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:14 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 Jul 09 05:25:14 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-21418919-1a49-480d-891b-a1bf52a96f01-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Lock "cinder-21418919-1a49-480d-891b-a1bf52a96f01-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Acquiring lock "cinder-quobyte-21418919-1a49-480d-891b-a1bf52a96f01" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:14 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-21418919-1a49-480d-891b-a1bf52a96f01" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:14 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[732dad23-d458-4af3-a29e-5d3fdadd3ce6]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:14 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:14 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 Jul 09 05:25:14 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:15 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2" returned: 0 in 0.674s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:15 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.info Jul 09 05:25:15 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:15 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01" returned: 0 in 0.776s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:15 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01 Jul 09 05:25:15 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:15 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.info" returned: 0 in 0.658s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:15 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.info is being set with open permissions: ugo+rw Jul 09 05:25:15 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:15 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.info Jul 09 05:25:15 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:16 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-21418919-1a49-480d-891b-a1bf52a96f01" returned: 0 in 0.636s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Lock "cinder-quobyte-21418919-1a49-480d-891b-a1bf52a96f01" released by "delete_volume" :: held 1.485s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Created reservations ['3c75bc7b-9616-4cac-867f-7a1f8c694638', '3cdccf8c-e5fa-4588-9ff5-3930bd3f10d6', 'd770c11f-c957-42e6-9ba6-18f904ee706d', 'bcc721af-546f-4d4b-9f6b-dd6593388d79'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:16 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:25:16 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:16 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.info" returned: 0 in 0.638s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:16 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.312s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:16 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-254d3a87-f17b-4ef6-91bc-e47afa5653d9 tempest-ProjectMemberTests-1563098389 None] Create snapshot completed successfully Jul 09 05:25:17 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.654s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:25:17 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Deleted volume successfully. Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-328de23c-26c8-4e7e-bc89-4a53291aa045 tempest-ProjectReaderTests-445434748 None] Lock "cinder-21418919-1a49-480d-891b-a1bf52a96f01-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Deleting offline snapshot fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 of volume 54a80b1f-c0cb-4c52-aa02-af6504e3fa06 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] snapshot_file for this snap is: volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec3817a-cad3-4f38-b3e4-eee230ff46c3]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:17 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:17 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 Jul 09 05:25:17 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:18 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2" returned: 0 in 0.798s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:18 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:25:18 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6adf2d-258e-4e9d-939b-2b9845699a10]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:18 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:18 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 Jul 09 05:25:18 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:19 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" returned: 0 in 0.751s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:19 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 Jul 09 05:25:19 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:19 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2" returned: 0 in 0.772s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:19 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:19 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2 Jul 09 05:25:19 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:20 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:20 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06.fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2" returned: 0 in 0.662s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2" released by "_delete_snapshot" :: held 3.083s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" released by "delete_snapshot" :: held 3.107s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:20 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Created reservations ['2e81c485-58a3-4c93-9ecf-fed769f10215', '751cbe30-2c1a-48f3-a4b9-9029eb6503cf', '397ca448-9f2b-42cd-be3f-04dc6df6e869', '4c88c788-c120-4ffc-9cb1-8f181a8e5a6e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:20 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Delete snapshot completed successfully. Jul 09 05:25:20 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-6b375f30-a997-479e-8e8a-5553731694c1 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-fbed495f-12c4-4cc5-b4d1-c04eed1ed9a2-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-54a80b1f-c0cb-4c52-aa02-af6504e3fa06-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-54a80b1f-c0cb-4c52-aa02-af6504e3fa06-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:21 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" acquired by "delete_volume" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:21 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dde435-70d5-4e04-bacb-816df0579aa9]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:21 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:21 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 Jul 09 05:25:21 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:22 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" returned: 0 in 0.756s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:22 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:22 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06 Jul 09 05:25:22 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:23 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" returned: 0 in 0.698s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:23 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-54a80b1f-c0cb-4c52-aa02-af6504e3fa06" released by "delete_volume" :: held 1.533s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:23 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:INSERT=32,cinder:UPDATE=124,cinder:SELECT=101,cinder:DELETE=13 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:25:23 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Created reservations ['f5851a4a-51ad-412c-b280-15ee60c7a491', 'cfb9affd-38e4-4810-9eb9-8ada97117fd0', 'ff4d6488-bc3b-4271-9a7f-69b2af1311fd', 'b24c3842-0202-4841-a093-f98083ff34fd'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:23 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:23 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:23 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:25:23 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:24 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.716s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:25:24 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Deleted volume successfully. Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-572dba16-8032-4292-8889-77e3413fcba5 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-54a80b1f-c0cb-4c52-aa02-af6504e3fa06-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=104,cinder:UPDATE=133,cinder:INSERT=40,cinder:DELETE=8 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (14500519-054b-4433-b649-82983f3e04fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166f3cee-066a-4c5e-b277-1e1e27f077eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166f3cee-066a-4c5e-b277-1e1e27f077eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-212940800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260b86ff-241d-4338-a4bf-d1aba5460ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:24Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6ea90e-da49-4338-8399-83b0bab89941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6ea90e-da49-4338-8399-83b0bab89941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ff77b7-f851-4dae-a14d-bce567b3bc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ff77b7-f851-4dae-a14d-bce567b3bc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260b86ff-241d-4338-a4bf-d1aba5460ebf', 'volume_name': 'volume-260b86ff-241d-4338-a4bf-d1aba5460ebf', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa051e4-16f5-4fd4-9a22-25862599d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa051e4-16f5-4fd4-9a22-25862599d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ca56d6-fa62-4bd9-b15c-b5f357fb65e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:24 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Volume 260b86ff-241d-4338-a4bf-d1aba5460ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260b86ff-241d-4338-a4bf-d1aba5460ebf', 'volume_size': 1} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-212940800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260b86ff-241d-4338-a4bf-d1aba5460ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:24Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Creating volume 260b86ff-241d-4338-a4bf-d1aba5460ebf {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:25:24 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:25:24 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:24 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf 1073741824 Jul 09 05:25:24 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:25 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf 1073741824" returned: 0 in 0.838s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:25 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:25 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf Jul 09 05:25:25 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:26 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf" returned: 0 in 0.712s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ca56d6-fa62-4bd9-b15c-b5f357fb65e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260b86ff-241d-4338-a4bf-d1aba5460ebf', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521bb122-f734-43c9-98f0-2e625a207c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:26 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Volume volume-260b86ff-241d-4338-a4bf-d1aba5460ebf (260b86ff-241d-4338-a4bf-d1aba5460ebf): created successfully Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521bb122-f734-43c9-98f0-2e625a207c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (14500519-054b-4433-b649-82983f3e04fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:26 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-362ffe5b-642f-44a9-8663-0e64ce7615b1 tempest-ProjectMemberTests-1563098389 None] Created volume successfully. Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Creating offline snapshot 909aa94b-df18-48bc-ae5b-8aaaad77c56f of volume 260b86ff-241d-4338-a4bf-d1aba5460ebf {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3600b84f-6101-47f3-8468-21141373ae96]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:26 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:26 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf Jul 09 05:25:26 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:27 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf" returned: 0 in 0.755s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:27 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:27 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f 1G Jul 09 05:25:27 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:28 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f 1G" returned: 0 in 0.847s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:28 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260b86ff-241d-4338-a4bf-d1aba5460ebf -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:28 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260b86ff-241d-4338-a4bf-d1aba5460ebf -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f Jul 09 05:25:28 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:29 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260b86ff-241d-4338-a4bf-d1aba5460ebf -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f" returned: 0 in 0.769s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:29 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f is being set with open permissions: ugo+rw Jul 09 05:25:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:29 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f Jul 09 05:25:29 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:29 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f" returned: 0 in 0.630s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:29 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:29 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.info Jul 09 05:25:29 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:30 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.info" returned: 0 in 0.675s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:30 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.info is being set with open permissions: ugo+rw Jul 09 05:25:30 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:30 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.info Jul 09 05:25:30 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:31 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.info" returned: 0 in 0.660s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:31 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.427s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:31 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-cac2159f-4e67-4762-b25f-ba4128169245 tempest-ProjectMemberTests-1563098389 None] Create snapshot completed successfully Jul 09 05:25:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-909aa94b-df18-48bc-ae5b-8aaaad77c56f-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-909aa94b-df18-48bc-ae5b-8aaaad77c56f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:31 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-260b86ff-241d-4338-a4bf-d1aba5460ebf" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-260b86ff-241d-4338-a4bf-d1aba5460ebf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-909aa94b-df18-48bc-ae5b-8aaaad77c56f" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-909aa94b-df18-48bc-ae5b-8aaaad77c56f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Deleting offline snapshot 909aa94b-df18-48bc-ae5b-8aaaad77c56f of volume 260b86ff-241d-4338-a4bf-d1aba5460ebf {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] snapshot_file for this snap is: volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce0c62c-cc54-42e8-a32f-73cdc1330462]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:32 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f Jul 09 05:25:32 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:32 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f" returned: 0 in 0.768s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-260b86ff-241d-4338-a4bf-d1aba5460ebf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[abffedb0-cdc5-4f43-8d66-17ec2e7aaf3d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:32 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:32 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf Jul 09 05:25:32 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:33 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf" returned: 0 in 0.784s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:33 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:33 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f Jul 09 05:25:33 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:34 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f" returned: 0 in 0.728s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:34 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:34 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f Jul 09 05:25:34 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:35 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:35 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf.909aa94b-df18-48bc-ae5b-8aaaad77c56f" returned: 0 in 0.678s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-909aa94b-df18-48bc-ae5b-8aaaad77c56f" released by "_delete_snapshot" :: held 3.065s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-260b86ff-241d-4338-a4bf-d1aba5460ebf" released by "delete_snapshot" :: held 3.093s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:35 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Created reservations ['3652a28b-fbdd-4aee-81b1-d8cff5c7ab76', '206ca174-8894-4742-a40e-3f41793cb1c5', '79b7b464-6210-4215-be9d-7341880571e4', '48750709-09a3-41a7-bf9c-36e5cdadec7c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:35 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Delete snapshot completed successfully. Jul 09 05:25:35 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-29c0b9c0-1f32-4686-b765-fdde5ce01fd4 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-909aa94b-df18-48bc-ae5b-8aaaad77c56f-delete_snapshot" released by "delete_snapshot" :: held 3.235s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-260b86ff-241d-4338-a4bf-d1aba5460ebf-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Lock "cinder-260b86ff-241d-4338-a4bf-d1aba5460ebf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-260b86ff-241d-4338-a4bf-d1aba5460ebf" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:36 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-260b86ff-241d-4338-a4bf-d1aba5460ebf" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:36 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8726a1a-841b-463d-bc40-c408cc66d12b]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:36 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:36 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf Jul 09 05:25:36 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:37 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf" returned: 0 in 0.768s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:37 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf Jul 09 05:25:37 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:37 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-260b86ff-241d-4338-a4bf-d1aba5460ebf" returned: 0 in 0.640s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Flow 'volume_create_manager' (0d98253e-3b1a-4490-b5bd-2422fc8f5b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63df5a9-3a0d-4737-a1b3-a7d6ccc6afbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-260b86ff-241d-4338-a4bf-d1aba5460ebf" released by "delete_volume" :: held 1.500s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63df5a9-3a0d-4737-a1b3-a7d6ccc6afbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1800759224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2734dc13-8c86-4b3d-a833-22cac11eacde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb746834fb804fc39ea9d63cd1759600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:38Z,use_quota=True,user_id='e1a2d4198d4947a499833ca970ad0257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff5833a-2ada-48f2-9fc8-f8375c926a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff5833a-2ada-48f2-9fc8-f8375c926a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069d19ff-b531-4a53-b7ce-fcb7c5083d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069d19ff-b531-4a53-b7ce-fcb7c5083d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2734dc13-8c86-4b3d-a833-22cac11eacde', 'volume_name': 'volume-2734dc13-8c86-4b3d-a833-22cac11eacde', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed6f175-891c-413e-aad3-487b4a493f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed6f175-891c-413e-aad3-487b4a493f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e66078-5290-45e2-9ba7-8f4606bd0086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:37 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Volume 2734dc13-8c86-4b3d-a833-22cac11eacde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2734dc13-8c86-4b3d-a833-22cac11eacde', 'volume_size': 1} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1800759224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2734dc13-8c86-4b3d-a833-22cac11eacde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb746834fb804fc39ea9d63cd1759600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:38Z,use_quota=True,user_id='e1a2d4198d4947a499833ca970ad0257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Creating volume 2734dc13-8c86-4b3d-a833-22cac11eacde {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:25:37 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:37 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde 1073741824 Jul 09 05:25:37 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Created reservations ['1eeca635-22d1-4d2e-8e58-6d7cfe108a04', 'a44990ef-b6ab-4dfb-a45b-3caba1b23398', '118adb6c-aeb3-441a-9912-da932595aa39', '47fc54d5-4b5a-4bed-a3d1-42d29cc6ee18'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:37 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:37 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:25:37 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:38 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.715s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:25:38 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Deleted volume successfully. Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d50b2e9e-6323-4beb-ab46-b43c3c53a50b tempest-ProjectMemberTests-1563098389 None] Lock "cinder-260b86ff-241d-4338-a4bf-d1aba5460ebf-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:38 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde 1073741824" returned: 0 in 0.917s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:38 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde Jul 09 05:25:38 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (516035a0-629e-4a48-9a66-07aa55ab0fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2d270f-d389-4498-955c-5be7e63ac26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2d270f-d389-4498-955c-5be7e63ac26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842708512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2cfdfab-6620-4e94-95ee-ca2eaecc1146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:39Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183c4ee3-c85b-4bc8-82a6-db089e74736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:38 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183c4ee3-c85b-4bc8-82a6-db089e74736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e94ecc6-5ffe-467a-94bf-64b8e3afb465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e94ecc6-5ffe-467a-94bf-64b8e3afb465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2cfdfab-6620-4e94-95ee-ca2eaecc1146', 'volume_name': 'volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c99568-cd34-4278-a2d4-65c93a2f5e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c99568-cd34-4278-a2d4-65c93a2f5e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641d5ca2-5597-465e-a289-133a5b2d3ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:39 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Volume e2cfdfab-6620-4e94-95ee-ca2eaecc1146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146', 'volume_size': 1} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:39 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:25:39 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:39 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde" returned: 0 in 0.699s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842708512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2cfdfab-6620-4e94-95ee-ca2eaecc1146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:39Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Creating volume e2cfdfab-6620-4e94-95ee-ca2eaecc1146 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:25:39 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:39 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 1073741824 Jul 09 05:25:39 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e66078-5290-45e2-9ba7-8f4606bd0086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2734dc13-8c86-4b3d-a833-22cac11eacde', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc5d508-3731-4b73-9311-ddd37b82e9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:39 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Volume volume-2734dc13-8c86-4b3d-a833-22cac11eacde (2734dc13-8c86-4b3d-a833-22cac11eacde): created successfully Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc5d508-3731-4b73-9311-ddd37b82e9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Flow 'volume_create_manager' (0d98253e-3b1a-4490-b5bd-2422fc8f5b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:39 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-7c3d74bc-5a12-4664-bb2d-0b44d59169e4 tempest-ProjectReaderTests-1260922443 None] Created volume successfully. Jul 09 05:25:39 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.675s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG oslo_service.periodic_task [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] Running periodic task VolumeManager._thread_info {{(pid=87161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread count: 28 {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-19a9179f-b8c6-4d69-a2f2-2d839f8009eb None None] thread info: [<_MainThread(MainThread, started 129544738324608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 05:25:39 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "cinder-2734dc13-8c86-4b3d-a833-22cac11eacde-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-2734dc13-8c86-4b3d-a833-22cac11eacde-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "cinder-quobyte-2734dc13-8c86-4b3d-a833-22cac11eacde" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:40 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-quobyte-2734dc13-8c86-4b3d-a833-22cac11eacde" acquired by "delete_volume" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:40 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[54332171-afcc-44e0-851b-1a335be8a056]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:40 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde Jul 09 05:25:40 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:40 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 1073741824" returned: 0 in 0.894s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:40 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 Jul 09 05:25:40 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:40 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde" returned: 0 in 0.797s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:40 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:40 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde Jul 09 05:25:40 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:41 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" returned: 0 in 0.628s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641d5ca2-5597-465e-a289-133a5b2d3ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9f45d5-01fb-4b9a-87e7-0439760082f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:41 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Volume volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 (e2cfdfab-6620-4e94-95ee-ca2eaecc1146): created successfully Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9f45d5-01fb-4b9a-87e7-0439760082f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (516035a0-629e-4a48-9a66-07aa55ab0fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:41 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-1d950f2d-08ad-4cb6-889e-daff56a496b7 tempest-ProjectMemberTests-1563098389 None] Created volume successfully. Jul 09 05:25:41 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-2734dc13-8c86-4b3d-a833-22cac11eacde" returned: 0 in 0.671s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-quobyte-2734dc13-8c86-4b3d-a833-22cac11eacde" released by "delete_volume" :: held 1.518s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Created reservations ['a2b0dcc3-42ef-4f87-ac0d-35add9b39d34', '7b1b25f4-bd2e-4388-9c6b-68e4c3773148', 'f366e7e4-43c4-4910-bda4-811907db0644', '0859bd4f-058e-4d9a-aa27-d305888ef0b9'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:41 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:41 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:25:41 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Creating offline snapshot 8cadaa69-1d59-482b-9193-f5be0ba6e9ae of volume e2cfdfab-6620-4e94-95ee-ca2eaecc1146 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d96bbc1-04fe-43a2-9936-d1dc9335f61d]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:42 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.670s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:25:42 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Deleted volume successfully. Jul 09 05:25:42 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 Jul 09 05:25:42 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-0d20fd3d-d630-437b-8baf-906c648fa7f5 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-2734dc13-8c86-4b3d-a833-22cac11eacde-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Flow 'volume_create_manager' (f2c7d525-6b42-410e-ad2b-ada740fbcc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e63d71a-ab5b-4fa8-9e49-8666ffce2c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e63d71a-ab5b-4fa8-9e49-8666ffce2c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253509363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8d3054-6114-4567-aabb-8e17e5cfed0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb746834fb804fc39ea9d63cd1759600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:43Z,use_quota=True,user_id='e1a2d4198d4947a499833ca970ad0257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c374be-54ec-4f09-ad52-1cf6acf38be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c374be-54ec-4f09-ad52-1cf6acf38be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646143c5-7b8e-4acd-8d30-5abb9b963925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646143c5-7b8e-4acd-8d30-5abb9b963925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8d3054-6114-4567-aabb-8e17e5cfed0e', 'volume_name': 'volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f430f24-f060-4f58-a551-0f6ee4dd54fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f430f24-f060-4f58-a551-0f6ee4dd54fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f48754-0428-4d50-83e5-f1a4858b0f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:42 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Volume ee8d3054-6114-4567-aabb-8e17e5cfed0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e', 'volume_size': 1} Jul 09 05:25:42 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:43 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" returned: 0 in 0.790s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:43 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae 1G Jul 09 05:25:43 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:43 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae 1G" returned: 0 in 0.776s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:43 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:43 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae Jul 09 05:25:43 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:44 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae" returned: 0 in 0.648s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:44 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae is being set with open permissions: ugo+rw Jul 09 05:25:44 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:44 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae Jul 09 05:25:44 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:45 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae" returned: 0 in 0.609s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:45 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.info Jul 09 05:25:45 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:45 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.info" returned: 0 in 0.614s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:45 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.info is being set with open permissions: ugo+rw Jul 09 05:25:45 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:45 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.info Jul 09 05:25:45 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:46 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.info" returned: 0 in 0.615s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.127s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.600s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253509363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8d3054-6114-4567-aabb-8e17e5cfed0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb746834fb804fc39ea9d63cd1759600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:43Z,use_quota=True,user_id='e1a2d4198d4947a499833ca970ad0257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Creating volume ee8d3054-6114-4567-aabb-8e17e5cfed0e {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:25:46 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:25:46 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:46 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e 1073741824 Jul 09 05:25:46 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:46 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-edaa4573-adc2-4c63-a407-ad9a4e435d25 tempest-ProjectMemberTests-1563098389 None] Create snapshot completed successfully Jul 09 05:25:47 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e 1073741824" returned: 0 in 0.785s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:47 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e Jul 09 05:25:47 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-8cadaa69-1d59-482b-9193-f5be0ba6e9ae-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-8cadaa69-1d59-482b-9193-f5be0ba6e9ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-8cadaa69-1d59-482b-9193-f5be0ba6e9ae" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-8cadaa69-1d59-482b-9193-f5be0ba6e9ae" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Deleting offline snapshot 8cadaa69-1d59-482b-9193-f5be0ba6e9ae of volume e2cfdfab-6620-4e94-95ee-ca2eaecc1146 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] snapshot_file for this snap is: volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a844adf9-9c67-49a4-9212-94dfb4409b17]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:47 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae Jul 09 05:25:47 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:47 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e" returned: 0 in 0.670s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f48754-0428-4d50-83e5-f1a4858b0f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b69916-4847-43f6-b3c0-884c45a95929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:47 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Volume volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e (ee8d3054-6114-4567-aabb-8e17e5cfed0e): created successfully Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b69916-4847-43f6-b3c0-884c45a95929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:47 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Flow 'volume_create_manager' (f2c7d525-6b42-410e-ad2b-ada740fbcc51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:47 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-3d0d4a39-9ddd-4956-9c15-d6395fcf0beb tempest-ProjectReaderTests-1260922443 None] Created volume successfully. Jul 09 05:25:48 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae" returned: 0 in 0.750s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:48 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:25:48 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[84876203-0621-43b7-ae1f-6e1a339b651f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:48 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:48 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 Jul 09 05:25:48 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:49 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" returned: 0 in 0.735s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Acquiring lock "cinder-ee8d3054-6114-4567-aabb-8e17e5cfed0e-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:49 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae Jul 09 05:25:49 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Lock "cinder-ee8d3054-6114-4567-aabb-8e17e5cfed0e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Acquiring lock "cinder-quobyte-ee8d3054-6114-4567-aabb-8e17e5cfed0e" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Lock "cinder-quobyte-ee8d3054-6114-4567-aabb-8e17e5cfed0e" acquired by "delete_volume" :: waited 0.015s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f0766d-412a-4440-934f-22b5b638bf41]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:49 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e Jul 09 05:25:49 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:49 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae" returned: 0 in 0.708s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:49 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae Jul 09 05:25:49 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:49 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e" returned: 0 in 0.767s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:49 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:49 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e Jul 09 05:25:49 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:50 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146.8cadaa69-1d59-482b-9193-f5be0ba6e9ae" returned: 0 in 0.613s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-8cadaa69-1d59-482b-9193-f5be0ba6e9ae" released by "_delete_snapshot" :: held 2.898s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" released by "delete_snapshot" :: held 2.924s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Created reservations ['ee59fe28-b35f-442e-a289-c017996c8492', '99bdd764-9615-4356-bd50-2f9503535ac1', '3c484700-27db-43f5-8d32-5dd3e9e56567', 'fb473e52-10cd-4c90-98cd-320f7e994e4c'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:50 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Delete snapshot completed successfully. Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-9e74d835-25da-451b-ab6e-e837855d6529 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-8cadaa69-1d59-482b-9193-f5be0ba6e9ae-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:50 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-ee8d3054-6114-4567-aabb-8e17e5cfed0e" returned: 0 in 0.648s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Lock "cinder-quobyte-ee8d3054-6114-4567-aabb-8e17e5cfed0e" released by "delete_volume" :: held 1.454s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-e2cfdfab-6620-4e94-95ee-ca2eaecc1146-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Created reservations ['5779a5a6-f0bf-4e7b-8449-c0969fb374fa', 'cf9c0ff7-0783-4880-91f8-2fe2efe821c9', 'cfcc059f-c994-4fe8-a6c5-00b0e019b67f', 'b1014e48-6f44-4d21-acae-bca0438ecd98'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-e2cfdfab-6620-4e94-95ee-ca2eaecc1146-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea28102-01f2-4672-9a4a-41a9b7d4dcfb]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:50 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:50 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:25:50 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:50 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 Jul 09 05:25:50 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:51 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.662s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:25:51 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Deleted volume successfully. Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-b0a81484-4a68-4c20-bc07-fa47ce43c37c tempest-ProjectReaderTests-1260922443 None] Lock "cinder-ee8d3054-6114-4567-aabb-8e17e5cfed0e-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:51 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" returned: 0 in 0.802s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:51 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146 Jul 09 05:25:51 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Flow 'volume_create_manager' (9c20170b-b4ce-4315-b1d1-45e61c7b5dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e8620a-759e-4540-8f0a-f34b22f86467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e8620a-759e-4540-8f0a-f34b22f86467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834622053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f912f280-d16e-4acd-bc33-6a178f130f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb746834fb804fc39ea9d63cd1759600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:52Z,use_quota=True,user_id='e1a2d4198d4947a499833ca970ad0257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee5f691-4abf-4245-afa1-7a651637fc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee5f691-4abf-4245-afa1-7a651637fc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ff6265-0af9-413c-ab2a-9d79f8ebcbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ff6265-0af9-413c-ab2a-9d79f8ebcbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f912f280-d16e-4acd-bc33-6a178f130f5a', 'volume_name': 'volume-f912f280-d16e-4acd-bc33-6a178f130f5a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afa2522-2b5b-4e89-ad62-d2825c585550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afa2522-2b5b-4e89-ad62-d2825c585550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cfdbcb-c8af-473b-a568-aa65e4b78791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:51 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Volume f912f280-d16e-4acd-bc33-6a178f130f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f912f280-d16e-4acd-bc33-6a178f130f5a', 'volume_size': 1} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834622053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f912f280-d16e-4acd-bc33-6a178f130f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb746834fb804fc39ea9d63cd1759600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:52Z,use_quota=True,user_id='e1a2d4198d4947a499833ca970ad0257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Creating volume f912f280-d16e-4acd-bc33-6a178f130f5a {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:25:51 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:25:51 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:51 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a 1073741824 Jul 09 05:25:51 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:52 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" returned: 0 in 0.644s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-e2cfdfab-6620-4e94-95ee-ca2eaecc1146" released by "delete_volume" :: held 1.521s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Created reservations ['18b057d9-c917-4d73-b04f-b60118612973', '68a0e66a-c6a0-4798-94c3-86c9f11ac429', '829c1eb1-5460-44ee-9b51-9be7e1b505b4', '11898caf-7a6b-4dfe-b66e-de255de44227'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:52 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:25:52 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:52 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a 1073741824" returned: 0 in 0.847s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:52 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:52 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a Jul 09 05:25:52 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:53 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.649s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:25:53 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Deleted volume successfully. Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-08f4ce55-8ce0-4614-96ee-16a5a7ec5b26 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-e2cfdfab-6620-4e94-95ee-ca2eaecc1146-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (1e48a99c-1ac1-4e65-9a83-c67ae5c9b5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c41bff0-9e9c-4832-8b0d-64bda5b8cf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c41bff0-9e9c-4832-8b0d-64bda5b8cf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100042186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45836d68-d1e4-4923-9e12-db7dd3b1a686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:53Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7cc878-851d-4e1e-9729-e26991641299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7cc878-851d-4e1e-9729-e26991641299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935aec57-3526-4fbb-828a-8c492fbf834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935aec57-3526-4fbb-828a-8c492fbf834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45836d68-d1e4-4923-9e12-db7dd3b1a686', 'volume_name': 'volume-45836d68-d1e4-4923-9e12-db7dd3b1a686', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621f08b4-6ee9-4136-a8e6-ef4981ba1a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621f08b4-6ee9-4136-a8e6-ef4981ba1a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:53 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6d57b6-3504-4ace-986a-1b87265233fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:53 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Volume 45836d68-d1e4-4923-9e12-db7dd3b1a686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45836d68-d1e4-4923-9e12-db7dd3b1a686', 'volume_size': 1} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a" returned: 0 in 0.701s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100042186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45836d68-d1e4-4923-9e12-db7dd3b1a686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6485eaae744d47a3a5b0f180f435e3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:53Z,use_quota=True,user_id='143e87ab1ede4b019d4e094e5e8f7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Creating volume 45836d68-d1e4-4923-9e12-db7dd3b1a686 {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:25:53 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cfdbcb-c8af-473b-a568-aa65e4b78791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f912f280-d16e-4acd-bc33-6a178f130f5a', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:53 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 1073741824 Jul 09 05:25:53 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dab2d0-c53f-4481-9988-3ed6ec678440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:53 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Volume volume-f912f280-d16e-4acd-bc33-6a178f130f5a (f912f280-d16e-4acd-bc33-6a178f130f5a): created successfully Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dab2d0-c53f-4481-9988-3ed6ec678440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Flow 'volume_create_manager' (9c20170b-b4ce-4315-b1d1-45e61c7b5dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:53 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-e9eb9f2b-0a03-4da4-81cf-4f7b0aca5a79 tempest-ProjectReaderTests-1260922443 None] Created volume successfully. Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "cinder-f912f280-d16e-4acd-bc33-6a178f130f5a-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-f912f280-d16e-4acd-bc33-6a178f130f5a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "cinder-quobyte-f912f280-d16e-4acd-bc33-6a178f130f5a" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-quobyte-f912f280-d16e-4acd-bc33-6a178f130f5a" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89ad190-bbbf-4c4d-b450-8a7641bba4bb]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:53 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:54 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a Jul 09 05:25:54 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:54 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 1073741824" returned: 0 in 0.830s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:54 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 Jul 09 05:25:54 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:54 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a" returned: 0 in 0.742s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:54 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a Jul 09 05:25:54 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:54 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686" returned: 0 in 0.679s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:54 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:25:54 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6d57b6-3504-4ace-986a-1b87265233fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45836d68-d1e4-4923-9e12-db7dd3b1a686', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94217066-5f65-44f5-86be-87fb33160fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:55 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Volume volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 (45836d68-d1e4-4923-9e12-db7dd3b1a686): created successfully Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94217066-5f65-44f5-86be-87fb33160fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Flow 'volume_create_manager' (1e48a99c-1ac1-4e65-9a83-c67ae5c9b5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:55 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-bc683863-34a4-433c-9580-21764f416a2d tempest-ProjectMemberTests-1563098389 None] Created volume successfully. Jul 09 05:25:55 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-f912f280-d16e-4acd-bc33-6a178f130f5a" returned: 0 in 0.666s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-quobyte-f912f280-d16e-4acd-bc33-6a178f130f5a" released by "delete_volume" :: held 1.450s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Created reservations ['0546400f-09fb-4d42-868f-581a6e4b6cef', '1c630e1c-c150-43e5-b4fc-93255277cfde', '61b0c57f-aad1-4282-92ef-54e7533d3821', 'b807ce0d-0aad-4dd6-9eb3-2f25be3dfa4e'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:55 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:25:55 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Creating offline snapshot fdce433d-1284-4150-b447-04062b4682d1 of volume 45836d68-d1e4-4923-9e12-db7dd3b1a686 {{(pid=87161) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eb5eef-8306-4f19-a71d-cc688114b57f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:25:55 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:55 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 Jul 09 05:25:55 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:56 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.663s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:25:56 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Deleted volume successfully. Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-4b2f8dd7-c7d0-48f9-9fd9-c3a5a365bbc2 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-f912f280-d16e-4acd-bc33-6a178f130f5a-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:25:56 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686" returned: 0 in 0.763s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 1G {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:56 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 1G Jul 09 05:25:56 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87161) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Flow 'volume_create_manager' (88147f5a-7546-405d-bedc-735a7272463b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d5b8fb-199d-464a-bcc2-8a108d237e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d5b8fb-199d-464a-bcc2-8a108d237e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415770604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2bf268-541d-4924-9734-703fe577e11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb746834fb804fc39ea9d63cd1759600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:57Z,use_quota=True,user_id='e1a2d4198d4947a499833ca970ad0257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3471aeb2-b0e6-4855-a8a3-94f1159902b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3471aeb2-b0e6-4855-a8a3-94f1159902b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078e1913-42ac-4273-ad9c-5711548e47b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078e1913-42ac-4273-ad9c-5711548e47b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2bf268-541d-4924-9734-703fe577e11e', 'volume_name': 'volume-fa2bf268-541d-4924-9734-703fe577e11e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20498580-acac-4545-b4fd-91e4338cf50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20498580-acac-4545-b4fd-91e4338cf50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e15cc73-0c59-4af2-ab7f-01d21512e6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:25:56 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Volume fa2bf268-541d-4924-9734-703fe577e11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2bf268-541d-4924-9734-703fe577e11e', 'volume_size': 1} Jul 09 05:25:56 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:57 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 1G" returned: 0 in 0.785s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:57 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 Jul 09 05:25:57 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:57 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 -F qcow2 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1" returned: 0 in 0.679s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:57 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 is being set with open permissions: ugo+rw Jul 09 05:25:57 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:57 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 Jul 09 05:25:57 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:58 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1" returned: 0 in 0.627s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:58 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:58 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.info Jul 09 05:25:58 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:59 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.info" returned: 0 in 0.648s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:59 devstack cinder-volume[87161]: WARNING cinder.volume.drivers.remotefs [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.info is being set with open permissions: ugo+rw Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.info {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:59 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.info Jul 09 05:25:59 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:59 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.info" returned: 0 in 0.649s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.229s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.145s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T03:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415770604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2bf268-541d-4924-9734-703fe577e11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb746834fb804fc39ea9d63cd1759600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T03:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T03:25:57Z,use_quota=True,user_id='e1a2d4198d4947a499833ca970ad0257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d219732-6f6e-4612-8e02-fdd26bb756cc),volume_type_id=9d219732-6f6e-4612-8e02-fdd26bb756cc)}" {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Creating volume fa2bf268-541d-4924-9734-703fe577e11e {{(pid=87161) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Selected osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b as target Quobyte volume. {{(pid=87161) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 05:25:59 devstack cinder-volume[87161]: INFO cinder.volume.drivers.remotefs [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] casted to osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b Jul 09 05:25:59 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e 1073741824 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:25:59 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e 1073741824 Jul 09 05:25:59 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:25:59 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-a5d823bd-85ab-4428-9cda-800f6678a022 tempest-ProjectMemberTests-1563098389 None] Create snapshot completed successfully Jul 09 05:26:00 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e 1073741824" returned: 0 in 0.801s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:00 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e Jul 09 05:26:00 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-fdce433d-1284-4150-b447-04062b4682d1-delete_snapshot" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-fdce433d-1284-4150-b447-04062b4682d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-45836d68-d1e4-4923-9e12-db7dd3b1a686" by "delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-45836d68-d1e4-4923-9e12-db7dd3b1a686" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-fdce433d-1284-4150-b447-04062b4682d1" by "_delete_snapshot" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-fdce433d-1284-4150-b447-04062b4682d1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Deleting offline snapshot fdce433d-1284-4150-b447-04062b4682d1 of volume 45836d68-d1e4-4923-9e12-db7dd3b1a686 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] snapshot_file for this snap is: volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 {{(pid=87161) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1885d8cc-4771-4200-9917-1def216cda5f]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:26:00 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:01 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 Jul 09 05:26:01 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:01 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e" returned: 0 in 0.646s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'} {{(pid=87161) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e15cc73-0c59-4af2-ab7f-01d21512e6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2bf268-541d-4924-9734-703fe577e11e', 'volume_size': 1}' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60d9c5b-f78b-455f-ba85-d84a45d00dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 05:26:01 devstack cinder-volume[87161]: INFO cinder.volume.flows.manager.create_volume [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Volume volume-fa2bf268-541d-4924-9734-703fe577e11e (fa2bf268-541d-4924-9734-703fe577e11e): created successfully Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60d9c5b-f78b-455f-ba85-d84a45d00dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87161) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Flow 'volume_create_manager' (88147f5a-7546-405d-bedc-735a7272463b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87161) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 05:26:01 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-2cea79c6-6468-422c-a47e-f951f0a1f07f tempest-ProjectReaderTests-1260922443 None] Created volume successfully. Jul 09 05:26:01 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1" returned: 0 in 0.777s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.remotefs [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45836d68-d1e4-4923-9e12-db7dd3b1a686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87161) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcf8e6e-4cc8-4896-a0d6-c07dcccb9445]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "cinder-fa2bf268-541d-4924-9734-703fe577e11e-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-fa2bf268-541d-4924-9734-703fe577e11e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "cinder-quobyte-fa2bf268-541d-4924-9734-703fe577e11e" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:26:01 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 Jul 09 05:26:01 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-quobyte-fa2bf268-541d-4924-9734-703fe577e11e" acquired by "delete_volume" :: waited 0.017s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea12d2cc-9fea-49fa-aa55-8efcf1566341]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:26:01 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:02 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e Jul 09 05:26:02 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:02 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686" returned: 0 in 0.747s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:02 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 Jul 09 05:26:02 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:02 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e" returned: 0 in 0.754s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:02 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:02 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e Jul 09 05:26:02 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:03 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1" returned: 0 in 0.728s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:03 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1 Jul 09 05:26:03 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:03 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-fa2bf268-541d-4924-9734-703fe577e11e" returned: 0 in 0.617s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-quobyte-fa2bf268-541d-4924-9734-703fe577e11e" released by "delete_volume" :: held 1.415s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Created reservations ['cee57eca-fe3b-4666-969c-db0829e44882', 'fbffc721-c515-475e-b848-a4de5ecc974c', 'e2aa7d39-d9b1-4b3e-9f16-7b2f6390b68d', '6d3aeb9e-3973-40ca-8bfe-377a428278c9'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:03 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:26:03 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:03 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686.fdce433d-1284-4150-b447-04062b4682d1" returned: 0 in 0.630s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-fdce433d-1284-4150-b447-04062b4682d1" released by "_delete_snapshot" :: held 2.979s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:26:03 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-45836d68-d1e4-4923-9e12-db7dd3b1a686" released by "delete_snapshot" :: held 3.003s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:26:04 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Created reservations ['1ac2086f-917f-4ced-9853-5930d6265204', 'a0dc4651-07e3-4074-a9ad-d7265b8a6d78', 'fcebeee3-7640-4953-b902-50d910685262', 'f430b29f-00fa-443a-ac1b-620921f43d75'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:26:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Delete snapshot completed successfully. Jul 09 05:26:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d33c1193-d3ba-40d7-b79e-f6febc86578d tempest-ProjectMemberTests-1563098389 None] Lock "cinder-fdce433d-1284-4150-b447-04062b4682d1-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:26:04 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:04 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.666s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:04 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:26:04 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Deleted volume successfully. Jul 09 05:26:04 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-06bfae92-4e51-43df-a584-6fba1ddf73a7 tempest-ProjectReaderTests-1260922443 None] Lock "cinder-fa2bf268-541d-4924-9734-703fe577e11e-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:26:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-45836d68-d1e4-4923-9e12-db7dd3b1a686-delete_volume" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:26:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-45836d68-d1e4-4923-9e12-db7dd3b1a686-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:26:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "cinder-quobyte-45836d68-d1e4-4923-9e12-db7dd3b1a686" by "delete_volume" {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 05:26:05 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-45836d68-d1e4-4923-9e12-db7dd3b1a686" acquired by "delete_volume" :: waited 0.023s {{(pid=87161) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 05:26:05 devstack cinder-volume[87161]: DEBUG oslo.privsep.daemon [-] privsep: reply[51459b40-307c-4289-8ab5-cbcad1df2a87]: (4, 'qcow2') {{(pid=88286) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 05:26:05 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:05 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 Jul 09 05:26:05 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:06 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686" returned: 0 in 0.761s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:06 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686 Jul 09 05:26:06 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:06 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5/volume-45836d68-d1e4-4923-9e12-db7dd3b1a686" returned: 0 in 0.624s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-quobyte-45836d68-d1e4-4923-9e12-db7dd3b1a686" released by "delete_volume" :: held 1.441s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG cinder.quota [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Created reservations ['c71ada82-e726-4074-a094-e5992b690b85', '87d9080e-0a5b-4a6c-a81b-db4013dff042', '54e3dd62-a839-4d00-8471-3c4593102234', '3b741e1e-3eef-45c6-920f-e775942efbf3'] {{(pid=87161) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b': None} {{(pid=87161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG cinder.volume.drivers.quobyte [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b9cad51-73d2-4b6c-b2c8-47937bc0f37b'] {{(pid=87161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.lockutils [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 05:26:06 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 05:26:06 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5 Jul 09 05:26:06 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 05:26:07 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Jul 09 05:26:07 devstack cinder-volume[87161]: DEBUG oslo_concurrency.processutils [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/576e7133d13a56e90cd60ab20a77fbd5" returned: 0 in 0.626s {{(pid=87161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 05:26:07 devstack cinder-volume[87161]: DEBUG cinder.manager [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Notifying Schedulers of capabilities ... {{(pid=87161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 05:26:07 devstack cinder-volume[87161]: INFO cinder.volume.manager [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Deleted volume successfully. Jul 09 05:26:07 devstack cinder-volume[87161]: DEBUG cinder.coordination [None req-d1b77ad5-783e-49d3-9846-f9a440c5add3 tempest-ProjectMemberTests-1563098389 None] Lock "cinder-45836d68-d1e4-4923-9e12-db7dd3b1a686-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87161) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 05:26:16 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:SELECT=71,cinder:INSERT=25,cinder:UPDATE=117,cinder:DELETE=10 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 05:26:17 devstack cinder-volume[87161]: DEBUG dbcounter [-] [87161] Writing DB stats cinder:UPDATE=87,cinder:DELETE=8,cinder:INSERT=27,cinder:SELECT=71 {{(pid=87161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}